-- Logs begin at Mon 2022-01-24 21:48:44 UTC, end at Mon 2022-01-24 22:48:17 UTC. -- Jan 24 22:19:21.711567 dv-cinder-813223-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 24 22:19:21.720383 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 24 22:19:21.722428 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 24 22:19:21 2022] *** Jan 24 22:19:21.722428 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 24 22:19:21.722428 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 24 22:19:21.722428 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: nodename: dv-cinder-813223-4-iscsi Jan 24 22:19:21.722428 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: machine: x86_64 Jan 24 22:19:21.722428 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: clock source: unix Jan 24 22:19:21.722428 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: pcre jit disabled Jan 24 22:19:21.722428 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: detected number of CPU cores: 4 Jan 24 22:19:21.722428 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: current working directory: / Jan 24 22:19:21.722428 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: detected binary path: /usr/bin/uwsgi-core Jan 24 22:19:21.722428 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: your processes number limit is 47680 Jan 24 22:19:21.722428 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: your memory page size is 4096 bytes Jan 24 22:19:21.722428 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: detected max file descriptor number: 2048 Jan 24 22:19:21.722428 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: lock engine: pthread robust mutexes Jan 24 22:19:21.723389 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: thunder lock: enabled Jan 24 22:19:21.723389 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 24 22:19:21.723389 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 24 22:19:21.766921 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: Python main interpreter initialized at 0x564156e939c0 Jan 24 22:19:21.766921 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: python threads support enabled Jan 24 22:19:21.766921 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: your server socket listen backlog is limited to 100 connections Jan 24 22:19:21.766921 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: your mercy for graceful operations on workers is 90 seconds Jan 24 22:19:21.767267 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: mapped 403077 bytes (393 KB) for 2 cores Jan 24 22:19:21.767342 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: *** Operational MODE: preforking *** Jan 24 22:19:21.767567 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: *** uWSGI is running in multiple interpreter mode *** Jan 24 22:19:21.767567 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: spawned uWSGI master process (pid: 101789) Jan 24 22:19:21.767768 dv-cinder-813223-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 24 22:19:21.768260 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: spawned uWSGI worker 1 (pid: 101790, cores: 1) Jan 24 22:19:21.768602 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: spawned uWSGI worker 2 (pid: 101791, cores: 1) Jan 24 22:19:21.768745 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 24 22:19:23.521772 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 22:19:23.521772 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: from cryptography.utils import int_from_bytes Jan 24 22:19:23.522553 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 22:19:23.522553 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: from cryptography.utils import int_from_bytes Jan 24 22:19:23.550931 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 22:19:23.550931 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: from cryptography.utils import int_from_bytes Jan 24 22:19:23.551506 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 22:19:23.551506 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: from cryptography.utils import int_from_bytes Jan 24 22:19:26.127020 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 24 22:19:26.127610 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 24 22:19:26.127710 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 24 22:19:26.127710 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 24 22:19:26.128132 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 24 22:19:26.128218 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 24 22:19:26.128300 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 24 22:19:26.128300 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 24 22:19:26.128453 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 24 22:19:26.128538 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 24 22:19:26.128686 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.128956 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.129106 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.129268 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.129359 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.129623 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.129757 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.129912 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.130019 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.130245 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.130369 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.130536 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.130630 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.130876 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.131002 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.131152 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.131248 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.131446 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.131573 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.131782 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.131935 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.132086 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813223-4-iscsi {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.132417 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.132511 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.132722 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.132822 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813223-4-iscsi {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.133042 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.133133 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.133364 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.133453 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.133667 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.133756 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.133980 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.134071 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.134282 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.134371 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.134604 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.134755 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.134898 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.135974 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.136077 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.136172 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.136241 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.136311 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.136383 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.136458 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.136533 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.136609 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.136674 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.136738 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.136930 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.137077 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.137217 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.137348 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.137553 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.137681 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.137860 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.138026 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.138172 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.138303 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813223-4-iscsi {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.138464 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.138591 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.138871 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813223-4-iscsi {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.139008 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.139179 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.139315 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.139477 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.139603 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.139804 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.139938 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.140164 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.140380 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.140520 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.140643 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.140769 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.140905 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.141114 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.141244 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.141428 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.141560 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.141730 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.141864 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.142050 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.142177 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.142353 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.142481 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.142651 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.142791 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.142944 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.143079 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.143240 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.143372 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.143562 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.143691 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.143862 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.143989 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.144163 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.144291 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.144530 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.144654 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.144774 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.144894 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.145041 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.145182 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.145319 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.145450 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.145571 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.145698 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.145832 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.145964 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.146088 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.146210 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.146387 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.146515 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.146668 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.146803 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.146991 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.147140 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.147445 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.147573 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.147848 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.147989 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.148128 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.148259 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.148444 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.148578 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.148739 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.148874 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.149050 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.149174 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.149375 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.149504 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.149670 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.149799 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.149983 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.150112 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.150302 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.150765 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.150953 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.151368 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.151500 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.151646 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.151646 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.151906 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.84 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.151906 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.84 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.152136 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.152255 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.152386 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.84 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.152512 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.152642 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.84 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.152773 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.152905 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.153105 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.153247 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.153434 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.153573 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.153746 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.153874 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.154047 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.154175 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.154335 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.154473 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.154637 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.154766 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.154960 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.155088 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.155254 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.155383 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.155577 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.155703 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.155823 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.155942 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.156070 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.156206 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.156389 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.156525 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.156698 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.156826 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.156980 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.157132 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.157318 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.157452 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.157587 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.157718 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.157901 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.158030 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.158190 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.158318 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.158495 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.158634 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.158788 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.158921 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.159094 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.159223 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.159395 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.159531 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.159684 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.159811 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.159993 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.160129 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.160282 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.160418 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.160591 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.160723 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.160855 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.160975 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.161205 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.161348 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.161525 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.161652 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.161812 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.161943 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.162116 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.162257 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.162387 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.162514 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.162739 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.162875 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.163058 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.163260 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.163528 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.163667 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.163790 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.163920 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.164049 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.164233 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.164363 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.164546 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.164674 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.164835 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.164964 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.165193 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.165319 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.165446 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.165574 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.165736 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.165868 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.166039 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.166170 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.166348 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.166481 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.166649 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.166782 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.166947 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.167072 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.167245 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.167377 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.167542 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.167674 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.167838 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.167968 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.168138 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.168269 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.168435 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.168569 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.168732 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.168864 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.169045 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.169174 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.169349 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.169484 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.169652 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.169778 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.169953 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.170077 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.170250 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.170374 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.170550 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.170675 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.170864 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.170995 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.171165 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.171290 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.171470 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.171601 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.171786 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:19:26.171911 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.172122 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.172255 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.172447 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.172571 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.172773 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.172911 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.173110 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.173234 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.173417 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.173544 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.173727 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.173866 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.174046 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.174171 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.174352 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.174477 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.174661 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.174798 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.174966 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.175091 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.175275 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.175397 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.175588 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.175712 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.175895 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.176018 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.176212 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.176334 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.176524 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.176662 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.176838 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.176963 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.177169 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.177295 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.177483 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.177624 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.177800 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.177931 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.178115 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.178239 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.178585 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.178802 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.178926 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.179159 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.179375 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.179712 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.179960 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.180166 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.180292 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.180522 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.180648 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.180872 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.181028 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.181215 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.181340 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.181529 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.181654 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.181841 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.181978 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.182167 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.182299 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.182476 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.182598 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.182786 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.182913 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.183098 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.183222 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.183418 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.183541 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.183735 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.183867 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.184038 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.184161 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.184340 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.184464 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.184643 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.184769 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.184955 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.185101 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.185295 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.185419 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.185605 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.185738 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.185915 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.186040 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.186218 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.186350 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.186520 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.186643 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.186838 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.186964 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.187150 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.187289 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.187456 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.187579 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.187761 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.187884 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.188071 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.188275 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.188408 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.188529 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.188675 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.188797 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.188977 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.189197 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.189323 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.189450 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.189601 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.189726 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.189900 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.190024 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.190204 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.190327 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.190506 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.190629 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.190808 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.190934 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.191118 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.191242 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.191422 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.191553 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.191730 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.191907 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.192033 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.192162 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.192335 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.192469 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.192644 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.192768 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.192951 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.193098 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.193285 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.193421 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.193608 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.193733 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.193971 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.194095 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.194524 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.194660 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.195109 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.195288 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.195433 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.195562 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.195720 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.195854 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.196093 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.196228 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.196350 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.196487 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.196609 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.196785 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.196920 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.197130 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.197258 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.197447 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.197587 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.197756 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.197882 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.198064 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.198189 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.198369 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.198512 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.198679 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.198806 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.198986 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.199111 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.199311 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.199439 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.199595 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.199721 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.199898 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.200022 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.200200 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.200333 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.200520 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.200653 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.200830 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.200954 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.201161 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.201287 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.201469 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.201594 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.201771 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.201896 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.202114 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.202243 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.202419 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.202544 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.202729 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.202854 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.203037 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.203163 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.203344 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.203469 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.203652 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.203779 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.203960 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.204086 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.204274 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.204398 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.204582 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.204716 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.204894 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.205033 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.205223 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.205349 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.205538 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.205678 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.205842 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.205966 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.206158 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.206282 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.206459 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.206595 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.206771 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.206904 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.207093 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.207227 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.207403 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.207536 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.207716 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.207839 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.208021 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.208144 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.208332 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.208470 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.208643 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.208768 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.208950 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.209122 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.209282 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.209409 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.209614 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.209741 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.210108 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.210237 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.210495 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.210619 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.210816 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.210942 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.211134 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.211253 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.211446 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.211574 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.211757 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.211889 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.212061 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.212186 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.212376 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.212501 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.212674 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.212798 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.213001 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.213122 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.213333 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.213464 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.213643 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.213770 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.213952 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.214084 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.214253 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.214376 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.214568 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.214692 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.214871 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.215003 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.215177 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.215313 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.215486 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.215612 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.215786 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.215920 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.216085 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.216203 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.216392 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.216517 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.216703 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.216837 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.217027 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.217168 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.217338 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.217463 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.217669 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.217793 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.217922 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.218044 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.218227 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.218359 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.218526 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.218659 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.218825 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.218957 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.219126 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.219249 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.219440 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.219565 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.219747 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.219870 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.220050 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.220174 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.220355 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.220488 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.220650 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.220772 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.220951 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.221167 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.221292 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.221420 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.221586 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.221724 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.221886 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.222020 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.222186 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.222320 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.222484 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.222610 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.222804 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.222935 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.223117 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.223241 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.223418 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.223542 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.223722 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.223860 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.224026 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.224150 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.224327 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.224450 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.224640 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.224768 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.224944 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.225090 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.225309 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.225462 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.225629 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.225914 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.226076 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.226248 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.226371 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.226522 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.226658 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.226828 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.226953 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.227131 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.227255 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.227437 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.227572 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.227760 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.227886 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.228066 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.228190 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.228370 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.228496 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.228673 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.228798 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.228972 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.229148 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.229282 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.229413 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.229598 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.229724 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.229952 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.230168 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.230309 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.230495 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.230620 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.230807 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.230939 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.231119 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.231272 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.231433 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.231552 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.231746 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.232000 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.232141 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.232333 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.232457 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.232655 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.232773 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.232959 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.233147 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.233284 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.233435 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.233560 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.233681 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.233861 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.233995 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.234167 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.234293 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.234465 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.234589 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.234764 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.234898 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.235064 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.235196 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.235367 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.235495 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.235668 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.235794 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.235995 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.236120 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.236294 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.236422 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.236597 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.236729 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.236902 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.237048 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.237226 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.237378 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.237528 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.237660 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.237830 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.237953 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.238148 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.238283 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.238450 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.238583 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.238749 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.238873 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.239049 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.239174 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.239351 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.239486 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.239651 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.239776 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.239971 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.240095 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.240280 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.240405 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.240583 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.240708 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.241109 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.241242 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.241420 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.241636 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.241846 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.241972 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.242101 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.242282 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.242409 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.242612 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.242738 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.242912 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.243038 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.243221 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.243348 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.243526 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.243654 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.243827 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.243960 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.244133 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.244257 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.244438 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.244564 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.244744 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.244867 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.245072 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.245198 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.245373 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.245506 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.245680 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.245806 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.245978 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.246117 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.246285 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.246409 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.246586 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.246709 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.246884 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.247018 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.247179 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.247311 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.247477 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.247601 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.247782 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.247915 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.248080 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.248204 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.248384 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.248508 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.248680 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.248814 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.248999 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.249137 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.249304 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.249428 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.249606 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.249733 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.249905 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.250030 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.250208 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.250330 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.250510 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.250642 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.250809 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.250935 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.251121 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.251245 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.251426 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.251555 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.251724 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.251855 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.252024 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.252150 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.252330 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.252464 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.252628 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.252753 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.252927 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.253085 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.253258 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.253383 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.253575 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.253703 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.253879 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.254018 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.254176 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.254299 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.254482 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.254613 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.254781 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.254914 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.255081 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.255206 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.255379 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.255504 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.255685 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.255828 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.255985 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.256111 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.256284 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.256430 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.256648 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.256772 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.257045 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.257227 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.257356 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.257590 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.257728 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.257898 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.258023 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.258209 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.258343 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.258512 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.258646 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.258813 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.258945 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.259114 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.259237 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.259416 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.259554 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.259718 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.259842 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.260038 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.260162 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.260346 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.260472 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.260647 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.260772 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.260952 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.261094 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.261278 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.261404 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.261585 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.261709 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.261890 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.262014 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.262205 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.262330 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.262512 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.262637 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.262827 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.262951 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.263134 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.263260 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.263438 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.263564 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.263746 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.263877 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.264053 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.264176 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.264352 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.264476 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.264667 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.264802 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.264977 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.265145 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.265319 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.265445 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.265621 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.265757 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.265925 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.266050 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.266233 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.266358 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.266540 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.266673 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.266844 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.266967 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.267150 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.267273 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.267462 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.267596 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.267772 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.267897 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.268071 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.268194 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.268374 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.268498 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.268679 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.268804 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.268977 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.269135 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.269306 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.269430 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.269611 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.269743 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.269913 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.270039 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.270227 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.270349 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.270512 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.270637 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.270814 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.270939 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.271119 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.271244 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.271419 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.271549 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.271723 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.271855 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.272107 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.272240 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.272584 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.272722 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.273043 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.273185 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.273311 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.273432 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.273552 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.273723 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.273850 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.274036 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.274164 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.274342 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.274476 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.274656 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.274781 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.274962 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.275089 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.275387 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.275847 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.276046 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.276181 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.276359 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.276483 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.276665 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.276790 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.276968 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.277127 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.277300 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.277426 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.277608 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.277732 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.277922 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.278054 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.278223 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.278347 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.278530 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.278663 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.278834 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.278972 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.279154 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.279306 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.279460 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.279585 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.279781 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.279907 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.280104 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.280223 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.280413 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.280544 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.280738 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.280851 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.281076 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.281219 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.281383 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.281520 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.281685 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.281812 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.282004 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.282129 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.282307 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.282434 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.282628 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.282754 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.282988 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.283112 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.283306 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.283444 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.283613 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.283737 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.283934 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.284066 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.284255 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.284388 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.284562 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.284686 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.284875 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.285028 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.285206 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.285344 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.285531 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.285658 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.285849 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.285974 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.286160 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.286284 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.286471 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.286597 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.286793 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.286910 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.287115 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.287234 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.287424 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.287548 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.287919 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.288053 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.288232 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.288494 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.288639 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.288808 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.288933 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.289145 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.289274 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.289450 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.289585 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.289752 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.289880 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.290073 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.290199 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.290376 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.290511 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.290683 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.290810 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.290991 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.291124 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.291296 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.291434 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.291598 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.291724 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.291897 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.292031 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.292214 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.292340 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.292515 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.292642 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.292835 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.292961 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.293173 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.293308 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.293484 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.293609 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.293796 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.293921 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.294094 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.294219 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.294400 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.294532 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.294704 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.294832 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.295001 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.295127 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.295302 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.295428 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.295602 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.295735 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.295922 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.296048 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.296227 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.296351 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.296544 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.296678 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.296863 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.297005 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.297192 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.297320 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.297510 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.297643 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.297817 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.297949 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.298121 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.298256 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.298424 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.298551 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.298726 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.298852 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.299053 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.299178 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.299357 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.299482 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.299655 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.299787 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.299963 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.300090 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.300264 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.300392 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.300566 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.300692 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.300865 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.301011 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.301195 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.301324 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.301495 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.301621 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.301794 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.301929 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.302093 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.302222 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.302411 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.302537 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.302710 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.302845 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.303028 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.303161 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.303395 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.303556 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.303688 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.303939 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.304067 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.304276 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.304407 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.304606 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.304741 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.304908 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.305053 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.305265 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.305392 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.305580 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.305721 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.305901 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.306027 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.306205 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.306328 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.306520 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.306654 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.306830 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.306954 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.307136 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.307262 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.307443 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.307578 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.307746 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.307870 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.308056 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.308179 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.308368 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.308502 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.308678 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.308803 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.309005 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.309146 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.309318 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.309454 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.309628 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.309755 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.309942 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.310065 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.310253 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.310386 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.310565 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.310771 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.310897 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.311097 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.311232 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.311407 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.311534 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.311715 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.311841 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.312023 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.312158 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.312332 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.312459 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.312639 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.312765 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.312945 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.313167 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.313293 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.313415 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.313574 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.313703 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.313881 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.314093 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.314232 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.314420 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.314548 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.314734 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.314868 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.315047 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.315172 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.315358 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.315490 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.315668 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.315794 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.315983 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.316110 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.316292 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.316426 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.316599 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.316726 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.316908 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.317056 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.317244 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.317377 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.317568 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.317694 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.317877 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.318001 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.318191 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.318328 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.318501 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.318628 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.318810 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.318962 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.319285 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.319603 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.319772 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.320097 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.320344 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.320464 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.320668 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.320795 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.320998 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.321139 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.321321 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.321447 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.321638 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.321765 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.321962 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.322087 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.322298 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.322432 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.322609 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.322734 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.322920 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.323051 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.323234 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.323373 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.323546 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.323664 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.323856 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.324063 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.324188 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.324377 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.324517 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.324706 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.324832 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.325050 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.325180 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.325373 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.325502 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.325689 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.325819 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.326004 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.326129 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.326327 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.326455 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.326631 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.326872 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.326998 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.327190 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.327312 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.327522 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.327646 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.327833 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.327958 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.328156 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.328290 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.328462 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.328589 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.328762 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.328887 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.329101 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.329242 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.329409 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.329542 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.329715 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.329934 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.330070 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.330280 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.330405 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.330593 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.330719 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.330916 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.331042 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.331226 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.331356 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.331530 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.331655 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.331834 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.331959 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.332147 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.332269 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.332448 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.332684 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.332823 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.333063 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.333191 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.333374 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.333497 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.333676 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.333804 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.333977 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.334102 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.334286 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.334420 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.334669 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.334799 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.334980 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.335279 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.335404 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.335579 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.335711 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.335902 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.336030 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.336205 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.336338 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.336505 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.336633 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.336805 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.336919 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.337137 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.337250 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.337442 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.337557 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.337747 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.337860 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.338049 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.338201 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.338348 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.338462 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.338652 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.338763 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.338948 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.339059 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.339353 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.339495 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.339615 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.339728 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.339841 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.339952 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.340116 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.340242 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.340422 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.340541 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.340720 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.340846 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.341050 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.341188 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.341353 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.341464 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.341653 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.341780 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.341956 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.342087 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.342261 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.342385 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.342563 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.342697 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.342874 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.342998 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.343177 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.343309 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.343488 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.343623 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.343793 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.343924 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.344117 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.344382 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.344517 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.344713 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.344838 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.345052 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.345287 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.345415 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.345608 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.345733 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.345941 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.346065 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.346257 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.346397 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.346600 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.346725 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.346853 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.346976 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.347164 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.347291 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.347473 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.347783 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.347915 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.348091 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.348217 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.348399 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.348528 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.348707 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.348834 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.349038 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.349180 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.349347 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.349429 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.349657 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.349754 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.349962 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.350048 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.350306 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.350417 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.350639 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.350830 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.350956 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.351269 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.351369 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.351597 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.351685 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.351977 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.352136 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.352222 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.352291 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.352496 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.352595 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.352799 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.352899 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.353127 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.353241 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.353441 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.353555 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.353771 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.354037 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.354127 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.354208 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.354370 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.354510 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.354805 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.354939 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.355123 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.355426 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.355555 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.355750 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.355887 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.356063 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.356190 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.356374 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.356498 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.356680 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.356813 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.357007 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.357157 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.357417 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.357543 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.357803 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.358110 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.358239 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.358439 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.358923 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.359048 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.359187 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.359311 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.359432 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.359683 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.359952 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.360080 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.360273 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.360528 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.360684 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.360894 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.361119 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.361263 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.361552 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.361710 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.361869 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.362294 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.362815 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.363156 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.363478 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.363808 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.364063 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.364212 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.364409 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.364550 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.364733 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.364860 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.365093 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.365222 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.365426 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.365567 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.365762 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.365927 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.366214 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.366371 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.366569 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.366766 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.366978 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.367106 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.367299 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.367427 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.367616 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.367744 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.367930 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.368057 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.368244 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.368371 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.368556 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.368684 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.368886 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.369045 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.369305 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.369631 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.369957 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.370278 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.370590 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.370927 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.371243 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.371532 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.371668 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.371857 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.371983 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.372170 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.372281 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.372481 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.372571 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.372791 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.372879 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.373142 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.373245 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.373470 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.373560 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.373775 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.373876 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.374100 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.374202 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.374419 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.374521 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.374742 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.374871 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.375057 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.375198 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.375368 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.375492 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.375684 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.375820 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.375996 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.376130 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.376311 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.376437 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.376620 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.376746 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.376931 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.377122 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.377258 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.377381 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.377578 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.377704 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.377907 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.378046 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.378232 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.378361 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.378561 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.378687 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.378872 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.378999 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.379178 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.379305 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.379428 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 24 22:19:26.379560 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.379850 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.380180 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.380496 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.380809 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.381144 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:19:26.381406 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 24 22:19:26.404129 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG oslo_db.sqlalchemy.engines [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 22:19:26.405057 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_db.sqlalchemy.engines [None req-7eead2ea-dd50-4998-8ed7-b8b4659d308d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 22:19:26.467930 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.context [None req-7eead2ea-dd50-4998-8ed7-b8b4659d308d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb394668-0391-4ba1-895f-69ebb5c46286(cell1) {{(pid=101790) load_cells /opt/stack/nova/nova/context.py:464}} Jan 24 22:19:26.468555 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.context [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb394668-0391-4ba1-895f-69ebb5c46286(cell1) {{(pid=101791) load_cells /opt/stack/nova/nova/context.py:464}} Jan 24 22:19:26.472193 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-7eead2ea-dd50-4998-8ed7-b8b4659d308d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:19:26.472725 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:19:26.473811 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-7eead2ea-dd50-4998-8ed7-b8b4659d308d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:19:26.474334 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:19:26.474625 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-7eead2ea-dd50-4998-8ed7-b8b4659d308d None None] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:19:26.475161 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:19:26.477031 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-7eead2ea-dd50-4998-8ed7-b8b4659d308d None None] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:19:26.477164 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:19:26.488543 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG oslo_db.sqlalchemy.engines [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 22:19:26.491709 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_db.sqlalchemy.engines [None req-7eead2ea-dd50-4998-8ed7-b8b4659d308d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 22:19:26.494696 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG oslo_db.sqlalchemy.engines [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 22:19:26.500648 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_db.sqlalchemy.engines [None req-7eead2ea-dd50-4998-8ed7-b8b4659d308d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 22:19:26.652439 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG oslo_db.sqlalchemy.engines [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 22:19:26.656051 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_db.sqlalchemy.engines [None req-7eead2ea-dd50-4998-8ed7-b8b4659d308d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 22:19:26.995887 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: WARNING keystonemiddleware.auth_token [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 22:19:26.999336 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: WARNING keystonemiddleware.auth_token [None req-7eead2ea-dd50-4998-8ed7-b8b4659d308d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 22:19:27.002385 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: WARNING keystonemiddleware.auth_token [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 22:19:27.005865 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: WARNING keystonemiddleware.auth_token [None req-7eead2ea-dd50-4998-8ed7-b8b4659d308d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 22:19:27.361897 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: WARNING keystonemiddleware.auth_token [None req-7eead2ea-dd50-4998-8ed7-b8b4659d308d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 22:19:27.362423 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: WARNING keystonemiddleware.auth_token [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 22:19:27.367527 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: WARNING keystonemiddleware.auth_token [None req-7eead2ea-dd50-4998-8ed7-b8b4659d308d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 22:19:27.367664 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: WARNING keystonemiddleware.auth_token [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 22:19:27.372873 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564156e939c0 pid: 101790 (default app) Jan 24 22:19:27.373041 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564156e939c0 pid: 101791 (default app) Jan 24 22:19:27.374975 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-7eead2ea-dd50-4998-8ed7-b8b4659d308d None None] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:19:27.376163 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-7eead2ea-dd50-4998-8ed7-b8b4659d308d None None] 10.222.0.84 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001752 Jan 24 22:19:27.376537 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 1/1] 10.222.0.84 () {50 vars in 788 bytes} [Mon Jan 24 22:19:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:20:53.707933 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:20:53.709175 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001972 Jan 24 22:20:53.709553 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 1/2] 10.222.0.84 () {54 vars in 930 bytes} [Mon Jan 24 22:20:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:20:54.153511 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-971ab914-76f9-4f0f-b400-860821ac9001 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:20:54.183344 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-971ab914-76f9-4f0f-b400-860821ac9001 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.467704 Jan 24 22:20:54.193158 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 2/3] 10.222.0.84 () {60 vars in 1291 bytes} [Mon Jan 24 22:20:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:20:56.467346 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:20:56.468367 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-828200a1-6eaf-4bb8-a2e0-3870db050f2f None None] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jan 24 22:20:56.469037 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 2/4] 10.222.0.84 () {54 vars in 930 bytes} [Mon Jan 24 22:20:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:20:56.531782 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-a25c2cfe-f211-4940-84df-39c1ce4a04b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "ram": 256, "name": "cirros256"}} {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:20:56.550306 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:20:56.550306 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: warnings.warn(msg) Jan 24 22:20:56.582591 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-a25c2cfe-f211-4940-84df-39c1ce4a04b5 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107284 Jan 24 22:20:56.584072 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 3/5] 10.222.0.84 () {64 vars in 1282 bytes} [Mon Jan 24 22:20:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:20:56.808333 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b9e42b75-3244-4b2a-8494-3f3fd48ec1ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:20:56.810923 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:20:56.810923 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Jan 24 22:20:56.860194 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b9e42b75-3244-4b2a-8494-3f3fd48ec1ec admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.268689 Jan 24 22:20:56.866438 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 3/6] 10.222.0.84 () {64 vars in 1335 bytes} [Mon Jan 24 22:20:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:20:59.149253 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-a25c2cfe-f211-4940-84df-39c1ce4a04b5 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:20:59.150303 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-a25c2cfe-f211-4940-84df-39c1ce4a04b5 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jan 24 22:20:59.150996 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 4/7] 10.222.0.84 () {54 vars in 930 bytes} [Mon Jan 24 22:20:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:20:59.258267 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5b4969dc-7c3d-437c-8637-05875f813bc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "disk": 5}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:20:59.281336 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:20:59.281336 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Jan 24 22:20:59.306416 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5b4969dc-7c3d-437c-8637-05875f813bc2 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148915 Jan 24 22:20:59.306992 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 4/8] 10.222.0.84 () {64 vars in 1282 bytes} [Mon Jan 24 22:20:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:20:59.319991 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-3eb0d221-9f52-4ea7-bead-93b15778def1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:20:59.321513 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:20:59.321513 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: warnings.warn(msg) Jan 24 22:20:59.361127 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-3eb0d221-9f52-4ea7-bead-93b15778def1 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045194 Jan 24 22:20:59.362874 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 5/9] 10.222.0.84 () {64 vars in 1335 bytes} [Mon Jan 24 22:20:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:21:01.639757 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5b4969dc-7c3d-437c-8637-05875f813bc2 admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:01.641080 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5b4969dc-7c3d-437c-8637-05875f813bc2 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001870 Jan 24 22:21:01.641970 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 5/10] 10.222.0.84 () {54 vars in 930 bytes} [Mon Jan 24 22:21:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:01.709357 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-f68da18b-5b1c-4aff-b04d-e7c84c765079 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0}} {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:01.732164 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-f68da18b-5b1c-4aff-b04d-e7c84c765079 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083200 Jan 24 22:21:01.732896 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 6/11] 10.222.0.84 () {64 vars in 1282 bytes} [Mon Jan 24 22:21:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:21:01.745055 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d64adffa-8afd-47cf-ab1a-bcb113d59251 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:01.769574 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d64adffa-8afd-47cf-ab1a-bcb113d59251 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028190 Jan 24 22:21:01.770325 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 6/12] 10.222.0.84 () {64 vars in 1335 bytes} [Mon Jan 24 22:21:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:21:04.083978 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-f68da18b-5b1c-4aff-b04d-e7c84c765079 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:04.085174 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-f68da18b-5b1c-4aff-b04d-e7c84c765079 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Jan 24 22:21:04.085516 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 7/13] 10.222.0.84 () {54 vars in 930 bytes} [Mon Jan 24 22:21:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:04.150105 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b190bd63-1d2a-4f8f-83ea-0656c9b0fc45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "name": "ds2G", "swap": 0, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:04.171179 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b190bd63-1d2a-4f8f-83ea-0656c9b0fc45 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079105 Jan 24 22:21:04.171934 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 7/14] 10.222.0.84 () {64 vars in 1282 bytes} [Mon Jan 24 22:21:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:21:04.184945 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-2c4bbd6f-af9e-4f6a-bf7f-ec6f739417fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:04.212722 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-2c4bbd6f-af9e-4f6a-bf7f-ec6f739417fa admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031593 Jan 24 22:21:04.213850 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 8/15] 10.222.0.84 () {64 vars in 1335 bytes} [Mon Jan 24 22:21:04 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:21:06.478517 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b190bd63-1d2a-4f8f-83ea-0656c9b0fc45 admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:06.480008 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b190bd63-1d2a-4f8f-83ea-0656c9b0fc45 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001940 Jan 24 22:21:06.480655 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 8/16] 10.222.0.84 () {54 vars in 930 bytes} [Mon Jan 24 22:21:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:06.541532 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-b90912bb-6fc1-40a4-94ff-8467e1c8ac0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:06.569461 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-b90912bb-6fc1-40a4-94ff-8467e1c8ac0e admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082665 Jan 24 22:21:06.570700 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 9/17] 10.222.0.84 () {64 vars in 1282 bytes} [Mon Jan 24 22:21:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:21:06.584745 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-674d6bed-2c61-464b-975f-a43fa0144d9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:06.609600 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-674d6bed-2c61-464b-975f-a43fa0144d9f admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028435 Jan 24 22:21:06.610317 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 9/18] 10.222.0.84 () {64 vars in 1335 bytes} [Mon Jan 24 22:21:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:21:08.923519 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-b90912bb-6fc1-40a4-94ff-8467e1c8ac0e admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:08.924747 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-b90912bb-6fc1-40a4-94ff-8467e1c8ac0e admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jan 24 22:21:08.925422 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 10/19] 10.222.0.84 () {54 vars in 930 bytes} [Mon Jan 24 22:21:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:08.988765 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a6312358-cd93-466d-aed3-92d94d990125 admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:09.013330 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a6312358-cd93-466d-aed3-92d94d990125 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081574 Jan 24 22:21:09.013897 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 10/20] 10.222.0.84 () {60 vars in 1291 bytes} [Mon Jan 24 22:21:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:21:11.289721 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-b90912bb-6fc1-40a4-94ff-8467e1c8ac0e admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:11.290650 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-b90912bb-6fc1-40a4-94ff-8467e1c8ac0e admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 Jan 24 22:21:11.291130 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 11/21] 10.222.0.84 () {54 vars in 930 bytes} [Mon Jan 24 22:21:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:11.349233 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-6adebda6-9196-4aab-a7e9-0fc32a4d90e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "name": "m1.tiny", "id": "1"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:11.369809 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-6adebda6-9196-4aab-a7e9-0fc32a4d90e6 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072831 Jan 24 22:21:11.370395 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 11/22] 10.222.0.84 () {64 vars in 1282 bytes} [Mon Jan 24 22:21:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:21:11.382558 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-f8ad69fd-b751-4477-937c-ff99faecfa51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:11.406698 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-f8ad69fd-b751-4477-937c-ff99faecfa51 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027725 Jan 24 22:21:11.407448 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 12/23] 10.222.0.84 () {64 vars in 1332 bytes} [Mon Jan 24 22:21:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:21:13.674291 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-6adebda6-9196-4aab-a7e9-0fc32a4d90e6 admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:13.675283 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-6adebda6-9196-4aab-a7e9-0fc32a4d90e6 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Jan 24 22:21:13.675972 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 12/24] 10.222.0.84 () {54 vars in 930 bytes} [Mon Jan 24 22:21:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:13.736550 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-25d329ce-8159-4395-8f20-88e7cdff0a58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "ram": 2048, "name": "m1.small", "os-flavor-access:is_public": true, "disk": 20}} {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:13.758656 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-25d329ce-8159-4395-8f20-88e7cdff0a58 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076413 Jan 24 22:21:13.759459 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 13/25] 10.222.0.84 () {64 vars in 1282 bytes} [Mon Jan 24 22:21:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:21:13.771487 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-779633f1-c73b-4317-bbe2-e99830d79562 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:13.796331 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-779633f1-c73b-4317-bbe2-e99830d79562 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028910 Jan 24 22:21:13.796952 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 13/26] 10.222.0.84 () {64 vars in 1332 bytes} [Mon Jan 24 22:21:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:21:16.078709 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-25d329ce-8159-4395-8f20-88e7cdff0a58 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:16.079778 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-25d329ce-8159-4395-8f20-88e7cdff0a58 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jan 24 22:21:16.080315 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 14/27] 10.222.0.84 () {54 vars in 930 bytes} [Mon Jan 24 22:21:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:16.145554 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-1e87ea17-134a-487b-82f3-c6301ef1376b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "vcpus": 2}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:16.165698 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-1e87ea17-134a-487b-82f3-c6301ef1376b admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079353 Jan 24 22:21:16.166262 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 14/28] 10.222.0.84 () {64 vars in 1282 bytes} [Mon Jan 24 22:21:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:21:16.177971 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-06fd266d-805b-479c-8c62-55740cb734da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:16.201908 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-06fd266d-805b-479c-8c62-55740cb734da admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027601 Jan 24 22:21:16.202519 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 15/29] 10.222.0.84 () {64 vars in 1332 bytes} [Mon Jan 24 22:21:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:21:18.497882 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-1e87ea17-134a-487b-82f3-c6301ef1376b admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:18.498923 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-1e87ea17-134a-487b-82f3-c6301ef1376b admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jan 24 22:21:18.499340 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 15/30] 10.222.0.84 () {54 vars in 930 bytes} [Mon Jan 24 22:21:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:18.560142 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-e5ad8bc5-9255-4925-8e66-d051374f9ea4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:18.584230 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-e5ad8bc5-9255-4925-8e66-d051374f9ea4 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078310 Jan 24 22:21:18.584963 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 16/31] 10.222.0.84 () {64 vars in 1282 bytes} [Mon Jan 24 22:21:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:21:18.596760 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-2395c968-827a-4839-8bcf-2445ac2eded3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:18.626452 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-2395c968-827a-4839-8bcf-2445ac2eded3 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033425 Jan 24 22:21:18.627249 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 16/32] 10.222.0.84 () {64 vars in 1332 bytes} [Mon Jan 24 22:21:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:21:20.937495 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-e5ad8bc5-9255-4925-8e66-d051374f9ea4 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:20.939612 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-e5ad8bc5-9255-4925-8e66-d051374f9ea4 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002222 Jan 24 22:21:20.939918 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 17/33] 10.222.0.84 () {54 vars in 930 bytes} [Mon Jan 24 22:21:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:21.003749 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-24906ad9-04ee-45e3-ad96-c5e9fd268b01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "id": "5"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:21.035435 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-24906ad9-04ee-45e3-ad96-c5e9fd268b01 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.089222 Jan 24 22:21:21.036074 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 17/34] 10.222.0.84 () {64 vars in 1282 bytes} [Mon Jan 24 22:21:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:21:21.047984 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-47ad41d0-3e4e-433a-bfe4-2dad27a4da80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:21.073577 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-47ad41d0-3e4e-433a-bfe4-2dad27a4da80 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029414 Jan 24 22:21:21.074504 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 18/35] 10.222.0.84 () {64 vars in 1332 bytes} [Mon Jan 24 22:21:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:21:43.924838 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-24906ad9-04ee-45e3-ad96-c5e9fd268b01 admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:43.925891 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-24906ad9-04ee-45e3-ad96-c5e9fd268b01 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jan 24 22:21:43.926265 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 18/36] 10.222.0.84 () {54 vars in 930 bytes} [Mon Jan 24 22:21:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:43.984642 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-a1a135da-0a09-4c01-9abc-7b2bb8533257 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:44.002359 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-a1a135da-0a09-4c01-9abc-7b2bb8533257 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069865 Jan 24 22:21:44.002926 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 19/37] 10.222.0.84 () {60 vars in 1291 bytes} [Mon Jan 24 22:21:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:21:45.376662 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-24906ad9-04ee-45e3-ad96-c5e9fd268b01 admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:45.377936 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-24906ad9-04ee-45e3-ad96-c5e9fd268b01 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Jan 24 22:21:45.378329 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 19/38] 10.222.0.84 () {56 vars in 1074 bytes} [Mon Jan 24 22:21:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:45.585833 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-f5d344db-fd5f-4e8b-b51d-7490f43ad2a4 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:45.591822 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.wsgi [None req-f5d344db-fd5f-4e8b-b51d-7490f43ad2a4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 24 22:21:45.592376 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-f5d344db-fd5f-4e8b-b51d-7490f43ad2a4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:21:45.593206 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-f5d344db-fd5f-4e8b-b51d-7490f43ad2a4 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062727 Jan 24 22:21:45.593707 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 20/39] 10.222.0.84 () {60 vars in 1190 bytes} [Mon Jan 24 22:21:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 24 22:21:45.602991 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-014032e0-c46e-4a18-85c0-891fb01ea00d admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:45.623592 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-014032e0-c46e-4a18-85c0-891fb01ea00d admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024108 Jan 24 22:21:45.624130 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 20/40] 10.222.0.84 () {60 vars in 1210 bytes} [Mon Jan 24 22:21:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:21:45.635905 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-54eab787-0c90-4466-ad23-d5a7e9d80011 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:45.665736 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-54eab787-0c90-4466-ad23-d5a7e9d80011 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034804 Jan 24 22:21:45.666267 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 21/41] 10.222.0.84 () {60 vars in 1210 bytes} [Mon Jan 24 22:21:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:21:45.677741 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-77e90cc6-1532-4748-9e44-ea3be9e42307 admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:45.685780 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-77e90cc6-1532-4748-9e44-ea3be9e42307 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 24 22:21:45.686602 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-77e90cc6-1532-4748-9e44-ea3be9e42307 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:21:45.687700 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-77e90cc6-1532-4748-9e44-ea3be9e42307 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015109 Jan 24 22:21:45.688370 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 21/42] 10.222.0.84 () {60 vars in 1190 bytes} [Mon Jan 24 22:21:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 24 22:21:46.971578 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-54eab787-0c90-4466-ad23-d5a7e9d80011 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:46.972620 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-54eab787-0c90-4466-ad23-d5a7e9d80011 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001895 Jan 24 22:21:46.973036 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 22/43] 10.222.0.84 () {56 vars in 1074 bytes} [Mon Jan 24 22:21:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:47.181269 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-631f9141-0640-424c-ab50-a3f2e9fefc96 admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:47.187080 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-631f9141-0640-424c-ab50-a3f2e9fefc96 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 24 22:21:47.187636 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-631f9141-0640-424c-ab50-a3f2e9fefc96 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:21:47.188421 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-631f9141-0640-424c-ab50-a3f2e9fefc96 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.071897 Jan 24 22:21:47.188926 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 22/44] 10.222.0.84 () {60 vars in 1190 bytes} [Mon Jan 24 22:21:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 24 22:21:47.201437 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-99044155-db1e-4799-9863-03c0d17c576e admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:47.222589 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-99044155-db1e-4799-9863-03c0d17c576e admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027053 Jan 24 22:21:47.223126 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 23/45] 10.222.0.84 () {60 vars in 1210 bytes} [Mon Jan 24 22:21:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:21:47.232663 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-142af843-842b-47dc-bb96-004b1861be7f admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:47.247175 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-142af843-842b-47dc-bb96-004b1861be7f admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017954 Jan 24 22:21:47.247721 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 23/46] 10.222.0.84 () {60 vars in 1210 bytes} [Mon Jan 24 22:21:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:21:47.259915 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-5b4a1837-0efe-430b-884f-f4d1e0096823 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:47.268046 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.wsgi [None req-5b4a1837-0efe-430b-884f-f4d1e0096823 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 24 22:21:47.268915 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-5b4a1837-0efe-430b-884f-f4d1e0096823 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:21:47.269738 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-5b4a1837-0efe-430b-884f-f4d1e0096823 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015716 Jan 24 22:21:47.270268 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 24/47] 10.222.0.84 () {60 vars in 1190 bytes} [Mon Jan 24 22:21:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 24 22:21:48.568202 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-142af843-842b-47dc-bb96-004b1861be7f admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:48.569250 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-142af843-842b-47dc-bb96-004b1861be7f admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jan 24 22:21:48.569633 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 24/48] 10.222.0.84 () {56 vars in 1074 bytes} [Mon Jan 24 22:21:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:48.780516 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-bdfe8476-41d5-4c0f-8599-e1210a05821f admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:48.785937 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.wsgi [None req-bdfe8476-41d5-4c0f-8599-e1210a05821f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 24 22:21:48.786489 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-bdfe8476-41d5-4c0f-8599-e1210a05821f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:21:48.787276 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-bdfe8476-41d5-4c0f-8599-e1210a05821f admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.078177 Jan 24 22:21:48.787788 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 25/49] 10.222.0.84 () {60 vars in 1193 bytes} [Mon Jan 24 22:21:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 24 22:21:48.797123 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-64754b90-d7aa-4889-be19-a54dfb5e6e66 admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:48.810611 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-64754b90-d7aa-4889-be19-a54dfb5e6e66 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017062 Jan 24 22:21:48.811108 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 25/50] 10.222.0.84 () {60 vars in 1210 bytes} [Mon Jan 24 22:21:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:21:48.820839 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-c5f3fee8-e834-451e-b1fd-d5b17a597173 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:48.834268 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-c5f3fee8-e834-451e-b1fd-d5b17a597173 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017247 Jan 24 22:21:48.834811 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 26/51] 10.222.0.84 () {60 vars in 1210 bytes} [Mon Jan 24 22:21:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:21:48.844094 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-50d1dd3e-83e2-4c2c-85c5-4a3e5a7326f0 admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:48.849714 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-50d1dd3e-83e2-4c2c-85c5-4a3e5a7326f0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 24 22:21:48.850269 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-50d1dd3e-83e2-4c2c-85c5-4a3e5a7326f0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:21:48.851046 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-50d1dd3e-83e2-4c2c-85c5-4a3e5a7326f0 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010551 Jan 24 22:21:48.851537 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 26/52] 10.222.0.84 () {60 vars in 1193 bytes} [Mon Jan 24 22:21:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 24 22:21:50.129627 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-c5f3fee8-e834-451e-b1fd-d5b17a597173 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:50.130642 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-c5f3fee8-e834-451e-b1fd-d5b17a597173 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jan 24 22:21:50.131039 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 27/53] 10.222.0.84 () {56 vars in 1074 bytes} [Mon Jan 24 22:21:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:50.336123 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-59383191-1602-49b8-90a0-597f0f7ff590 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:50.359309 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-59383191-1602-49b8-90a0-597f0f7ff590 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.088542 Jan 24 22:21:50.360033 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 27/54] 10.222.0.84 () {64 vars in 1235 bytes} [Mon Jan 24 22:21:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:21:51.623231 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-c5f3fee8-e834-451e-b1fd-d5b17a597173 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:51.624258 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-c5f3fee8-e834-451e-b1fd-d5b17a597173 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jan 24 22:21:51.624645 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 28/55] 10.222.0.84 () {56 vars in 1074 bytes} [Mon Jan 24 22:21:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:51.827420 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-55099a73-ab33-4022-8210-66673e7fcd6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:51.848254 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-55099a73-ab33-4022-8210-66673e7fcd6a admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.085744 Jan 24 22:21:51.848792 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 28/56] 10.222.0.84 () {64 vars in 1235 bytes} [Mon Jan 24 22:21:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:21:53.132114 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-c5f3fee8-e834-451e-b1fd-d5b17a597173 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:53.133160 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-c5f3fee8-e834-451e-b1fd-d5b17a597173 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jan 24 22:21:53.133545 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 29/57] 10.222.0.84 () {56 vars in 1074 bytes} [Mon Jan 24 22:21:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:53.327969 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4f21cea4-2b25-424e-8c94-cd865d32783f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:53.351135 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4f21cea4-2b25-424e-8c94-cd865d32783f admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.077783 Jan 24 22:21:53.352016 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 29/58] 10.222.0.84 () {64 vars in 1235 bytes} [Mon Jan 24 22:21:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:21:54.624591 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-c5f3fee8-e834-451e-b1fd-d5b17a597173 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:54.625990 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-c5f3fee8-e834-451e-b1fd-d5b17a597173 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002027 Jan 24 22:21:54.626528 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 30/59] 10.222.0.84 () {56 vars in 1074 bytes} [Mon Jan 24 22:21:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:54.836264 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e331b5f4-3b15-446c-be69-88ded9ee3e70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:21:54.863979 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e331b5f4-3b15-446c-be69-88ded9ee3e70 admin admin] 10.222.0.84 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.098357 Jan 24 22:21:54.864450 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 30/60] 10.222.0.84 () {64 vars in 1235 bytes} [Mon Jan 24 22:21:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:21:56.174324 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-c5f3fee8-e834-451e-b1fd-d5b17a597173 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:56.175499 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-c5f3fee8-e834-451e-b1fd-d5b17a597173 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001956 Jan 24 22:21:56.175948 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 31/61] 10.222.0.84 () {56 vars in 1074 bytes} [Mon Jan 24 22:21:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:21:56.387267 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-130c0f85-3317-4114-b47b-882091766e54 admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:21:56.406915 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-130c0f85-3317-4114-b47b-882091766e54 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.087934 Jan 24 22:21:56.407446 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 31/62] 10.222.0.84 () {60 vars in 1202 bytes} [Mon Jan 24 22:21:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:22:43.158216 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-c5f3fee8-e834-451e-b1fd-d5b17a597173 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:22:43.159222 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-c5f3fee8-e834-451e-b1fd-d5b17a597173 admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jan 24 22:22:43.159626 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 32/63] 10.222.0.84 () {54 vars in 930 bytes} [Mon Jan 24 22:22:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:22:43.230132 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-3d30b2df-bc25-4318-a208-db9cc1512288 admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:22:43.250143 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-3d30b2df-bc25-4318-a208-db9cc1512288 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.083788 Jan 24 22:22:43.250701 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 32/64] 10.222.0.84 () {60 vars in 1291 bytes} [Mon Jan 24 22:22:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:22:43.273495 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-883feab0-42cb-417b-a99b-ce233122a412 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:22:43.281262 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-883feab0-42cb-417b-a99b-ce233122a412 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012000 Jan 24 22:22:43.281775 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 33/65] 10.222.0.84 () {60 vars in 1282 bytes} [Mon Jan 24 22:22:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:22:43.293400 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b97d1a2b-4889-47e5-bef6-da6ccf719832 admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:22:43.301167 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b97d1a2b-4889-47e5-bef6-da6ccf719832 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011312 Jan 24 22:22:43.301713 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 33/66] 10.222.0.84 () {60 vars in 1285 bytes} [Mon Jan 24 22:22:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:22:43.312545 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-8a0942c6-e8e4-48c2-a33e-80540dcbc4c0 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:22:43.320621 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-8a0942c6-e8e4-48c2-a33e-80540dcbc4c0 admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011482 Jan 24 22:22:43.321102 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 34/67] 10.222.0.84 () {60 vars in 1285 bytes} [Mon Jan 24 22:22:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:22:43.332277 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0ad59f06-b217-4679-9870-b2573d5976ac admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:22:43.340069 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0ad59f06-b217-4679-9870-b2573d5976ac admin admin] 10.222.0.84 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011329 Jan 24 22:22:43.340861 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 34/68] 10.222.0.84 () {60 vars in 1282 bytes} [Mon Jan 24 22:22:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:24:18.781940 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-02530199-a52e-4968-8b11-4312ef54029f tempest-verify_tempest_config-1396995671 tempest-verify_tempest_config-1396995671-project] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:24:18.784868 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-02530199-a52e-4968-8b11-4312ef54029f tempest-verify_tempest_config-1396995671 tempest-verify_tempest_config-1396995671-project] 10.222.0.84 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.134218 Jan 24 22:24:18.785584 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 35/69] 10.222.0.84 () {58 vars in 1133 bytes} [Mon Jan 24 22:24:18 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:25:52.871153 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0ad59f06-b217-4679-9870-b2573d5976ac admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:25:52.872759 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0ad59f06-b217-4679-9870-b2573d5976ac admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002228 Jan 24 22:25:52.873431 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 35/70] 10.222.0.84 () {56 vars in 1074 bytes} [Mon Jan 24 22:25:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:25:53.146624 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-8a77b52c-aca3-44c8-a3b6-ab3c1fe4c878 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:25:53.147790 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:25:53.147790 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: warnings.warn(msg) Jan 24 22:25:53.149419 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-8a77b52c-aca3-44c8-a3b6-ab3c1fe4c878 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:25:53.149861 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-8a77b52c-aca3-44c8-a3b6-ab3c1fe4c878 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:25:53.150651 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-8a77b52c-aca3-44c8-a3b6-ab3c1fe4c878 admin admin] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:25:53.151070 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-8a77b52c-aca3-44c8-a3b6-ab3c1fe4c878 admin admin] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:25:53.184747 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-8a77b52c-aca3-44c8-a3b6-ab3c1fe4c878 admin admin] 10.222.0.84 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152573 Jan 24 22:25:53.185338 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 36/71] 10.222.0.84 () {60 vars in 1193 bytes} [Mon Jan 24 22:25:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:25:54.507468 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0ad59f06-b217-4679-9870-b2573d5976ac admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:25:54.508458 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0ad59f06-b217-4679-9870-b2573d5976ac admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jan 24 22:25:54.508841 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 36/72] 10.222.0.84 () {56 vars in 1074 bytes} [Mon Jan 24 22:25:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:25:54.711575 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-71260e99-73e2-4a55-ab68-026732d829af admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:25:54.712743 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:25:54.712743 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: warnings.warn(msg) Jan 24 22:25:54.714308 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-71260e99-73e2-4a55-ab68-026732d829af admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:25:54.714752 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-71260e99-73e2-4a55-ab68-026732d829af admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:25:54.715601 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-71260e99-73e2-4a55-ab68-026732d829af admin admin] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:25:54.716025 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-71260e99-73e2-4a55-ab68-026732d829af admin admin] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:25:54.734760 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-71260e99-73e2-4a55-ab68-026732d829af admin admin] 10.222.0.84 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085327 Jan 24 22:25:54.735306 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 37/73] 10.222.0.84 () {60 vars in 1193 bytes} [Mon Jan 24 22:25:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:26:06.478339 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0ad59f06-b217-4679-9870-b2573d5976ac admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:26:06.479363 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0ad59f06-b217-4679-9870-b2573d5976ac admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jan 24 22:26:06.479748 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 37/74] 10.222.0.84 () {56 vars in 1074 bytes} [Mon Jan 24 22:26:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:26:06.683553 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-b0f712a8-1db9-4000-a34f-2b3177c30986 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:26:06.684700 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:26:06.684700 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: warnings.warn(msg) Jan 24 22:26:06.686280 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-b0f712a8-1db9-4000-a34f-2b3177c30986 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:26:06.687062 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-b0f712a8-1db9-4000-a34f-2b3177c30986 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:26:06.687870 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-b0f712a8-1db9-4000-a34f-2b3177c30986 admin admin] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:26:06.688323 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-b0f712a8-1db9-4000-a34f-2b3177c30986 admin admin] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:26:06.711964 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-b0f712a8-1db9-4000-a34f-2b3177c30986 admin admin] 10.222.0.84 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084815 Jan 24 22:26:06.712506 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 38/75] 10.222.0.84 () {60 vars in 1193 bytes} [Mon Jan 24 22:26:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:26:08.034275 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0ad59f06-b217-4679-9870-b2573d5976ac admin admin] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:26:08.035309 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0ad59f06-b217-4679-9870-b2573d5976ac admin admin] 10.222.0.84 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jan 24 22:26:08.035689 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 38/76] 10.222.0.84 () {56 vars in 1074 bytes} [Mon Jan 24 22:26:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:26:08.243516 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG nova.api.openstack.wsgi [None req-73f686f6-f686-4b43-9126-ecac331c7de5 admin admin] Calling method '>' {{(pid=101790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:26:08.244678 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:26:08.244678 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: warnings.warn(msg) Jan 24 22:26:08.246271 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-73f686f6-f686-4b43-9126-ecac331c7de5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:26:08.246715 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-73f686f6-f686-4b43-9126-ecac331c7de5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:26:08.247515 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-73f686f6-f686-4b43-9126-ecac331c7de5 admin admin] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:26:08.247938 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: DEBUG oslo_concurrency.lockutils [None req-73f686f6-f686-4b43-9126-ecac331c7de5 admin admin] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:26:08.270219 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: INFO nova.api.openstack.requestlog [None req-73f686f6-f686-4b43-9126-ecac331c7de5 admin admin] 10.222.0.84 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.092804 Jan 24 22:26:08.270784 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: [pid: 101790|app: 0|req: 39/77] 10.222.0.84 () {60 vars in 1193 bytes} [Mon Jan 24 22:26:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:27:05.640482 dv-cinder-813223-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 24 22:27:05.641053 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: Mon Jan 24 22:27:05 2022 - graceful shutdown triggered... Jan 24 22:27:05.641494 dv-cinder-813223-4-iscsi devstack@n-api.service[101790]: Gracefully killing worker 1 (pid: 101790)... Jan 24 22:27:05.641845 dv-cinder-813223-4-iscsi devstack@n-api.service[101791]: Gracefully killing worker 2 (pid: 101791)... Jan 24 22:27:06.642200 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: worker 1 buried after 1 seconds Jan 24 22:27:06.642200 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: worker 2 buried after 1 seconds Jan 24 22:27:06.642200 dv-cinder-813223-4-iscsi devstack@n-api.service[101789]: goodbye to uWSGI. Jan 24 22:27:06.644895 dv-cinder-813223-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 24 22:27:06.645836 dv-cinder-813223-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 24 22:27:06.649377 dv-cinder-813223-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 24 22:27:06.668173 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 24 22:27:06.670867 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 24 22:27:06 2022] *** Jan 24 22:27:06.670867 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 24 22:27:06.670867 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 24 22:27:06.670867 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: nodename: dv-cinder-813223-4-iscsi Jan 24 22:27:06.670867 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: machine: x86_64 Jan 24 22:27:06.670867 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: clock source: unix Jan 24 22:27:06.670867 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: pcre jit disabled Jan 24 22:27:06.670867 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: detected number of CPU cores: 4 Jan 24 22:27:06.670867 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: current working directory: / Jan 24 22:27:06.670867 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: detected binary path: /usr/bin/uwsgi-core Jan 24 22:27:06.670867 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: your processes number limit is 47680 Jan 24 22:27:06.670867 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: your memory page size is 4096 bytes Jan 24 22:27:06.670867 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: detected max file descriptor number: 2048 Jan 24 22:27:06.670867 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: lock engine: pthread robust mutexes Jan 24 22:27:06.671861 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: thunder lock: enabled Jan 24 22:27:06.671861 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 24 22:27:06.671861 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 24 22:27:06.716639 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: Python main interpreter initialized at 0x55a52d8999c0 Jan 24 22:27:06.716639 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: python threads support enabled Jan 24 22:27:06.716639 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: your server socket listen backlog is limited to 100 connections Jan 24 22:27:06.716639 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: your mercy for graceful operations on workers is 90 seconds Jan 24 22:27:06.717182 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: mapped 403077 bytes (393 KB) for 2 cores Jan 24 22:27:06.717182 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: *** Operational MODE: preforking *** Jan 24 22:27:06.717419 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: *** uWSGI is running in multiple interpreter mode *** Jan 24 22:27:06.717419 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: spawned uWSGI master process (pid: 116455) Jan 24 22:27:06.717626 dv-cinder-813223-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 24 22:27:06.718214 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: spawned uWSGI worker 1 (pid: 116466, cores: 1) Jan 24 22:27:06.721025 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: spawned uWSGI worker 2 (pid: 116467, cores: 1) Jan 24 22:27:06.721025 dv-cinder-813223-4-iscsi devstack@n-api.service[116455]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 24 22:27:08.675037 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 22:27:08.675037 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: from cryptography.utils import int_from_bytes Jan 24 22:27:08.675814 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 22:27:08.675814 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: from cryptography.utils import int_from_bytes Jan 24 22:27:08.684599 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 22:27:08.684599 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: from cryptography.utils import int_from_bytes Jan 24 22:27:08.685338 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 22:27:08.685338 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: from cryptography.utils import int_from_bytes Jan 24 22:27:11.088358 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 24 22:27:11.089089 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 24 22:27:11.089089 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 24 22:27:11.089474 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 24 22:27:11.089595 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 24 22:27:11.089972 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.090330 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.090626 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.090979 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.091311 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.091632 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.091957 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.092277 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.092605 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.092832 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.093198 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.093539 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813223-4-iscsi {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.093819 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.094131 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.094464 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.094783 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.095088 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.095409 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.095718 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.096542 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.097485 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.098034 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.098598 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.099274 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.099834 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.101142 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.101725 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.102281 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.102934 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.103485 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.104136 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813223-4-iscsi {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.105107 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.105662 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.106203 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.106863 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.107537 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.108079 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.108628 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.109196 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.109772 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.110127 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.110673 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.111129 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.111604 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.111929 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.112331 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.112667 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.113045 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.113376 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.113701 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.113965 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.114289 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.114794 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.115259 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.115600 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.115864 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.116128 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.116757 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.117117 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.117588 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.117918 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.118245 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.118571 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.118895 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.119218 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.119539 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.119861 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.120191 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.120653 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.121022 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.121473 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.121805 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.122220 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.84 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.122484 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.84 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.122805 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.123160 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.123492 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.123811 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.124140 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.124474 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.124906 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.125363 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.125686 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.126021 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.126373 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.126691 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.126951 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.127262 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.127610 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.127938 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.128262 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.128579 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.128896 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.129236 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.129553 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.129871 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.130190 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.130536 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.130856 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.131172 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.131600 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.132092 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.132596 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.132946 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.133318 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.133637 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.133958 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.134277 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.134597 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.135045 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.135490 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.135810 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.136145 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.136464 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.136899 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 24 22:27:11.137386 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.137477 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 24 22:27:11.137570 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.137832 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.137916 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 24 22:27:11.137998 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.138076 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 24 22:27:11.138302 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.138412 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 24 22:27:11.138567 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.138681 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.138868 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.138976 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.139215 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.139377 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.139517 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.139713 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.139895 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.140054 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.140217 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.140376 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.140538 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.140707 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.140853 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.141063 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.141196 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.141401 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.141540 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.141666 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.141858 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.141971 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.142170 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.142311 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813223-4-iscsi {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.142501 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.142643 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.142831 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.142959 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.143481 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.143626 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.143809 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.143956 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.144109 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.144270 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.144440 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.144602 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.144789 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.144917 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.145284 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.145472 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.145641 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.145801 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.145968 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.146117 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.146309 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.146436 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.146649 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.146781 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.146978 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.147108 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.147299 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.147465 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.147953 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.148174 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.148369 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.148473 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.148558 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.148828 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.148974 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.149187 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.149342 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.149563 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.149712 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813223-4-iscsi {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.149894 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.150044 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.150190 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.150291 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.150542 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.150678 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.150836 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.150925 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.151181 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.151316 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.151592 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.151726 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.151893 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.152027 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.152223 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.152358 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.152541 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.152677 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.152861 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.152968 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.153221 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.153323 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.153546 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.153639 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.153876 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.153984 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.154185 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.154284 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.154505 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.154605 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.154820 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.154921 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.155150 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.155298 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.155463 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.155556 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.155774 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.155876 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.156029 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.156207 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.156336 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.156531 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.156665 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.156852 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.157009 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.157226 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.157368 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.157539 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.157640 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.157849 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.157937 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.158167 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.158264 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.158497 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.158629 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.158815 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.158940 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.159128 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.159218 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.159441 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.159529 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.159754 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.159847 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.160069 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.160157 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.160389 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.160479 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.160705 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.160793 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.161046 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.161149 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.161370 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.161466 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.161695 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.161818 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.162015 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.162137 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.162328 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.162426 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.162647 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.162752 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.162971 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.163130 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.84 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.163287 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.163438 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.84 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.163618 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.163931 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.164019 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.164242 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.164338 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.164574 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.164663 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.164892 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.165064 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.165254 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.165344 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.165585 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.165681 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.165905 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.166002 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.166225 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.166321 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.166543 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.166640 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.166872 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.166972 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.167215 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.167310 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.167528 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.167632 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.167787 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.167940 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.168096 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.168286 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.168409 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.168605 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.168736 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.168941 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.169133 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.169376 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.169465 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.169693 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.169798 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.170002 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.170102 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.170316 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.170412 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.170629 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.170724 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.170944 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.171040 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.171256 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.171351 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.171572 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.171666 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.171885 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.171995 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.172194 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.172292 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.172503 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.172599 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.172815 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.172918 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.173152 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.173264 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.173479 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.173575 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.173795 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.173883 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.174108 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.174195 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.174418 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.174515 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.174728 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.174827 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.175055 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.175155 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.175423 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.175537 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.175682 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.175886 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.176013 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.176232 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.176327 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.176563 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.176659 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.176896 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.177014 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.177246 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.177344 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.177574 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.177662 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.177893 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.177989 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.178199 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.178298 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.178515 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.178614 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.178876 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.178983 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.179201 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.179472 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.179569 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.179834 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.179931 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.180154 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.180252 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.180485 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.180574 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.180800 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.180902 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.181182 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.181272 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.181500 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.181592 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.181816 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.181929 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.182131 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.182257 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.182455 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.182545 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.182786 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.182874 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.183105 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.183201 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.183425 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.183512 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.183741 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.183914 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.184069 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 22:27:11.184158 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.184389 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.184484 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.184715 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.184813 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.185062 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.185152 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.185407 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.185513 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.185748 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.185853 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.186073 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.186169 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.186393 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.186495 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.186710 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.186805 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.187039 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.187135 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.187378 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.187483 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.187694 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.187789 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.188011 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.188098 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.188330 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.188433 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.188661 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.188769 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.188999 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.189089 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.189346 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.189437 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.189707 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.189812 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.189989 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.190088 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.190306 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.190404 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.190625 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.190725 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.190937 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.191024 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.191250 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.191390 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.191569 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.191668 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.191891 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.191987 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.192211 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.192312 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.192527 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.192659 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.192839 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.192940 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.193186 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.193275 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.193504 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.193602 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.193816 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.193912 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.194126 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.194214 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.194598 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.194695 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.195047 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.195170 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.195472 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.195569 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.195818 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.195919 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.196137 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.196239 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.196452 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.196546 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.196765 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.196862 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.197120 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.197227 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.197438 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.197527 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.197754 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.197850 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.198065 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.198163 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.198374 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.198469 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.198689 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.198787 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.199016 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.199108 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.199329 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.199417 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.199652 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.199747 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.199982 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.200070 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.200293 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.200389 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.200611 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.200698 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.200929 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.201051 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.201274 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.201364 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.201590 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.201690 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.201911 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.202006 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.202248 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.202387 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.202543 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.202645 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.202874 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.203003 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.203189 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.203288 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.203500 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.203622 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.203833 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.203961 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.204151 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.204279 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.204467 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.204600 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.204791 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.204922 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.205137 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.205461 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.205784 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.205934 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.206115 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.206211 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.206439 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.206535 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.206759 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.207087 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.207183 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.207433 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.207522 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.207750 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.207847 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.208081 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.208202 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.208415 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.208511 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.208742 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.208857 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.209079 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.209183 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.209400 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.209494 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.209715 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.209817 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.210152 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.210244 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.210480 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.210570 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.210800 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.210898 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.211117 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.211222 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.211440 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.211544 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.211752 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.211856 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.212064 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.212151 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.212377 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.212499 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.212694 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.212791 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.213044 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.213192 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.213343 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.213446 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.213654 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.213753 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.213965 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.214071 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.214286 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.214381 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.214599 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.214699 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.214919 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.215021 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.215233 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.215328 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.215564 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.215653 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.215888 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.215987 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.216200 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.216306 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.216512 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.216600 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.216822 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.216912 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.217394 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.217492 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.217632 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.217792 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.217959 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.218121 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.218309 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.218442 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.218648 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.218772 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.219004 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.219113 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.219317 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.219407 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.219637 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.219739 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.219973 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.220061 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.220288 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.220383 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.220600 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.220697 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.220914 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.221025 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.221259 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.221347 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.221593 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.221758 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.221892 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.222008 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.222215 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.222316 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.222533 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.222648 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.222851 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.222957 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.223168 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.223302 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.223478 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.223569 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.223795 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.223883 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.224105 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.224200 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.224427 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.224549 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.224740 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.224860 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.225081 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.225172 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.225394 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.225484 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.225761 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.225849 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.226103 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.226459 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.226577 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.226741 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.226820 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.227593 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.227755 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.227755 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.227892 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.227960 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.228026 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.228026 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.228275 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.228454 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.228610 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.228763 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.228917 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.229189 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.229359 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.229515 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.229668 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.229819 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.229964 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.230115 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.230466 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.230616 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.230760 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.231079 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.231333 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.231418 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.231508 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.231597 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.231696 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.231826 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.231923 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.232075 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.232172 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.232263 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.232354 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.232437 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.232577 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.232708 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.232888 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.233022 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.233234 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.233323 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.233548 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.233639 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.233862 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.234004 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.234174 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.234271 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.234493 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.234580 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.234806 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.234902 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.235117 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.235208 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.235427 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.235516 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.235748 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.235846 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.236121 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.236251 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.236349 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.236441 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.236663 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.236763 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.236978 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.237094 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.237312 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.237412 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.237624 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.237722 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.237977 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.238065 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.238285 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.238372 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.238612 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.238701 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.238939 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.239036 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.239262 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.239387 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.239583 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.239694 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.239901 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.240000 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.240219 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.240403 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.240540 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.240650 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.240852 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.240948 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.241264 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.241370 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.241623 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.241778 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.241949 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.242274 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.242370 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.242614 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.242704 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.242938 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.243030 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.243261 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.243357 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.243583 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.243682 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.243898 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.243993 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.244219 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.244309 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.244547 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.244635 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.244860 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.245178 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.245274 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.245518 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.245614 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.245838 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.245926 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.246233 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.246367 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.246467 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.246550 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.246789 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.246905 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.247125 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.247310 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.247465 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.247638 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.247788 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.247966 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.248104 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.248288 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.248424 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.248607 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.248741 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.248928 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.249079 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.249275 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.249400 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.249591 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.249720 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.249923 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.250036 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.250244 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.250342 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.250559 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.250655 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.250878 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.250969 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.251193 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.251291 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.251501 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.251585 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.251855 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.251982 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.252194 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.252340 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.252509 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.252616 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.252832 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.252964 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.253176 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.253281 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.253511 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.253615 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.253828 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.253916 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.254145 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.254274 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.254458 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.254557 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.254770 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.254864 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.255117 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.255205 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.255434 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.255532 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.255778 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.255881 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.256113 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.256208 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.256429 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.256537 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.256739 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.256932 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.257235 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.257335 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.257626 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.257778 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.257946 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.258102 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.258264 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.258421 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.258578 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.258739 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.258911 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.259061 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.259228 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.259381 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.259562 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.259700 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.259984 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.260083 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.260305 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.260409 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.260622 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.260711 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.260936 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.261068 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.261275 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.261377 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.261597 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.261697 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.261909 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.262007 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.262235 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.262343 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.262550 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.262650 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.262863 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.262952 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.263175 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.263267 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.263494 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.263582 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.263814 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.263902 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.264126 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.264223 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.264445 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.264549 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.264757 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.264854 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.265111 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.265218 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.265428 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.265519 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.265741 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.265837 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.266053 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.266150 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.266370 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.266473 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.266688 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.266801 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.266997 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.267109 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.267331 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.267429 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.267651 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.267758 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.267964 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.268100 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.268620 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.268758 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.268936 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.269097 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.269274 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.269419 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.269587 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.269731 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.269905 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.270028 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.270237 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.270350 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.270564 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.270659 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.270875 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.270964 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.271194 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.271281 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.271506 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.271615 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.271821 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.271921 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.272129 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.272240 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.272498 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.272658 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.272837 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.273000 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.273192 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.273497 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.273587 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.273819 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.273917 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.274136 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.274231 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.274446 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.274580 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.274777 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.274866 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.275093 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.275179 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.275404 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.275498 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.275714 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.275810 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.276026 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.276121 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.276378 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.276546 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.276734 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.276834 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.277034 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.277126 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.277378 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.277479 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.277696 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.277785 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.278019 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.278105 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.278341 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.278436 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.278663 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.278752 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.278984 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.279073 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.279299 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.279395 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.279621 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.279710 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.279931 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.280018 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.280245 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.280380 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.280556 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.280644 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.280866 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.280952 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.281202 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.281309 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.281517 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.281613 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.281838 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.281960 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.282148 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.282259 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.282460 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.282576 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.282768 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.282867 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.283092 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.283188 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.283413 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.283519 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.283733 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.283831 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.284049 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.284139 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.284362 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.284460 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.284678 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.284779 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.285014 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.285118 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.285329 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.285421 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.285649 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.285884 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.286024 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.286122 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.286275 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.286366 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.286590 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.286703 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.286909 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.287010 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.287231 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.287324 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.287543 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.287644 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.287874 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.287973 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.288294 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.288399 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.288625 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.288861 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.288952 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.289234 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.289343 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.289556 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.289656 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.289880 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.290032 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.290197 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.290296 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.290525 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.290627 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.290850 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.290951 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.291175 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.291266 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.291560 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.291852 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.291944 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.292192 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.292288 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.292515 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.292836 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.292836 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.293080 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.293166 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.293248 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.293484 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.293595 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.293807 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.293907 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.294129 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.294219 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.294451 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.294542 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.294770 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.294875 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.295086 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.295187 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.295408 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.295506 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.295741 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.295828 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.296051 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.296153 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.296365 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.296462 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.296679 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.296774 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.297035 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.297165 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.297353 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.297443 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.297682 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.297779 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.298095 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.298198 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.298413 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.298501 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.298726 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.298821 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.299045 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.299136 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.299370 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.299467 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.299693 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.299782 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.300041 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.300139 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.300361 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.300450 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.300684 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.300781 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.301019 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.301109 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.301338 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.301427 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.301652 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.301754 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.301985 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.302089 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.302307 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.302413 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.302624 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.302728 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.302950 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.303058 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.303259 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.303349 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.303588 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.303734 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.304020 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.304120 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.304363 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.304579 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.304943 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.305102 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.305389 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.305477 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.305720 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.305808 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.306041 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.306132 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.306375 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.306478 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.306699 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.306794 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.307013 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.307111 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.307334 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.307434 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.307648 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.307735 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.307959 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.308056 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.308270 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.308367 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.308600 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.308771 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.308914 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.309030 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.309258 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.309347 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.309578 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.309686 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.309894 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.309984 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.310205 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.310293 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.310517 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.310614 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.310850 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.311116 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.311206 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.311474 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.311569 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.311797 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.311896 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.312126 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.312222 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.312456 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.312571 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.312766 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.312860 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.313118 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.313211 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.313439 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.313542 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.313751 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.313843 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.314061 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.314150 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.314369 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.314467 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.314697 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.314783 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.315012 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.315107 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.315332 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.315438 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.315652 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.315741 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.315970 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.316060 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.316284 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.316375 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.316603 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.316700 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.316915 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.317060 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.317274 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.317418 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.317599 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.317697 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.317928 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.318016 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.318238 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.318341 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.318550 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.318647 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.318861 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.318956 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.319170 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.319258 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.319598 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.319689 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.319918 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.320157 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.320248 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.320483 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.320585 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.320801 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.320889 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.321144 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.321245 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.321458 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.321548 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.321772 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.321861 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.322092 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.322180 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.322439 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.322571 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.322739 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.322837 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.323054 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.323152 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.323368 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.323460 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.323679 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.323823 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.323996 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.324085 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.324327 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.324422 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.324647 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.324745 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.324966 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.325075 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.325324 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.325431 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.325660 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.325765 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.325980 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.326247 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.326345 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.326595 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.326692 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.326925 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.327023 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.327255 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.327377 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.327589 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.327696 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.327903 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.328002 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.328220 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.328310 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.328532 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.328629 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.328851 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.328940 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.329192 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.329283 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.329512 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.329615 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.329832 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.329921 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.330151 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.330370 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.330467 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.330712 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.330801 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.331039 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.331130 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.331362 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.331465 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.331681 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.331768 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.332000 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.332098 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.332321 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.332459 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.332641 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.332732 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.332960 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.333081 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.333306 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.333400 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.333627 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.333731 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.333952 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.334054 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.334270 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.334363 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.334588 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.334677 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.334924 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.335024 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.335275 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.335480 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.335603 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.335940 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.336030 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.336265 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.336354 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.336578 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.336705 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.340199 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.340367 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.340507 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.340621 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.340728 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.340835 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.340950 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.341099 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.341216 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.341339 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.341459 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.341567 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.341682 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.341804 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.341914 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.342028 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.342143 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.342249 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.342355 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.342469 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.342593 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.342695 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.342816 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.342913 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.343016 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.343100 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.343189 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.343316 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.343406 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.343489 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.343662 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.343759 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.343843 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.343933 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.344013 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.344083 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.344175 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.344266 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.344356 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.344444 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.344444 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.344592 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.344687 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.344778 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.344860 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.344947 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.345061 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.345155 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.345244 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.345327 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.345414 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.345495 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.345583 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.345662 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.345732 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.345812 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.345900 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.345994 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.346125 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.346231 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.346447 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.346548 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.346769 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.346859 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.347090 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.347189 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.347410 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.347505 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.347729 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.347822 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.348044 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.348134 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.348368 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.348457 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.348689 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.348800 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.349078 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.349274 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.349406 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.349635 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.349751 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.349964 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.350088 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.350295 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.350417 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.350643 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.350767 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.350983 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.351150 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.351313 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.351614 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.351787 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.351941 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.352101 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.352256 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.352408 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.352560 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.352701 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.352866 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.353009 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.353211 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.353325 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.353527 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.353643 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.353842 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.353958 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.354163 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.354279 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.354906 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.355016 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.355103 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.355193 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.355275 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.355364 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.355454 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.355544 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.355706 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.355841 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.356020 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.356118 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.356346 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.356446 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.356639 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 24 22:27:11.356728 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.356970 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.357311 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.357626 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.357939 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.358251 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.358569 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.358883 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.359201 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.359513 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.359834 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.360147 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.360466 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.360778 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.361135 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.361451 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.361764 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.362092 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.362413 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.362744 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.363067 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.363386 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.363742 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.364070 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.364672 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.365047 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.365366 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.365709 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.366048 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.366564 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.367057 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.367390 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.367731 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.368058 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.368383 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.368706 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.369053 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.369382 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.369704 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.370025 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.370349 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.370669 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.370990 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.371316 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.371670 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.372001 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.372329 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.372655 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.372993 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.373325 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.373644 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.373963 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.374281 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.374667 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.374955 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.375638 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.376242 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.376691 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.377041 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.377384 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.377723 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.378049 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.378384 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.378722 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.379048 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.379382 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.379707 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.380046 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.380232 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_db.sqlalchemy.engines [None req-700f9004-10d2-418b-a264-fd0e7abc8a71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 22:27:11.380397 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.380738 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.381100 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.381420 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.381738 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.382262 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.382592 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.382937 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.383287 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.383617 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.383950 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.384274 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.384616 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.384931 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.385283 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.385617 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.385948 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.386274 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.386618 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.386944 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.387275 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.387598 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.387921 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.388241 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.388559 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.388897 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.389258 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.389577 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.389914 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.390243 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.390571 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.390898 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.391221 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.391560 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.391890 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.392218 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.392539 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.392861 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.393551 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.393877 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.394213 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.394549 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.394968 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.395213 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.395569 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.395891 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.396247 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.396585 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.396908 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.397265 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.397690 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 22:27:11.398129 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 24 22:27:11.421534 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_db.sqlalchemy.engines [None req-0c830a7f-f7fb-43a9-b182-8f53126223c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 22:27:11.445738 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.context [None req-700f9004-10d2-418b-a264-fd0e7abc8a71 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb394668-0391-4ba1-895f-69ebb5c46286(cell1) {{(pid=116467) load_cells /opt/stack/nova/nova/context.py:464}} Jan 24 22:27:11.450078 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-700f9004-10d2-418b-a264-fd0e7abc8a71 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:11.451693 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-700f9004-10d2-418b-a264-fd0e7abc8a71 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:11.452507 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-700f9004-10d2-418b-a264-fd0e7abc8a71 None None] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:11.454507 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-700f9004-10d2-418b-a264-fd0e7abc8a71 None None] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:11.465787 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_db.sqlalchemy.engines [None req-700f9004-10d2-418b-a264-fd0e7abc8a71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 22:27:11.466501 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_db.sqlalchemy.engines [None req-700f9004-10d2-418b-a264-fd0e7abc8a71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 22:27:11.485169 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.context [None req-0c830a7f-f7fb-43a9-b182-8f53126223c7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb394668-0391-4ba1-895f-69ebb5c46286(cell1) {{(pid=116466) load_cells /opt/stack/nova/nova/context.py:464}} Jan 24 22:27:11.489662 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0c830a7f-f7fb-43a9-b182-8f53126223c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:11.491432 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0c830a7f-f7fb-43a9-b182-8f53126223c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:11.492692 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0c830a7f-f7fb-43a9-b182-8f53126223c7 None None] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:11.494770 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0c830a7f-f7fb-43a9-b182-8f53126223c7 None None] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:11.505568 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_db.sqlalchemy.engines [None req-0c830a7f-f7fb-43a9-b182-8f53126223c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 22:27:11.506391 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_db.sqlalchemy.engines [None req-0c830a7f-f7fb-43a9-b182-8f53126223c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 22:27:11.631961 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_db.sqlalchemy.engines [None req-700f9004-10d2-418b-a264-fd0e7abc8a71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 22:27:11.675599 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_db.sqlalchemy.engines [None req-0c830a7f-f7fb-43a9-b182-8f53126223c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 22:27:11.956648 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: WARNING keystonemiddleware.auth_token [None req-700f9004-10d2-418b-a264-fd0e7abc8a71 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 22:27:11.963764 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: WARNING keystonemiddleware.auth_token [None req-700f9004-10d2-418b-a264-fd0e7abc8a71 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 22:27:11.999136 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: WARNING keystonemiddleware.auth_token [None req-0c830a7f-f7fb-43a9-b182-8f53126223c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 22:27:12.006192 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: WARNING keystonemiddleware.auth_token [None req-0c830a7f-f7fb-43a9-b182-8f53126223c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 22:27:12.308924 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: WARNING keystonemiddleware.auth_token [None req-700f9004-10d2-418b-a264-fd0e7abc8a71 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 22:27:12.314254 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: WARNING keystonemiddleware.auth_token [None req-700f9004-10d2-418b-a264-fd0e7abc8a71 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 22:27:12.319538 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a52d8999c0 pid: 116467 (default app) Jan 24 22:27:12.347179 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: WARNING keystonemiddleware.auth_token [None req-0c830a7f-f7fb-43a9-b182-8f53126223c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 22:27:12.352934 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: WARNING keystonemiddleware.auth_token [None req-0c830a7f-f7fb-43a9-b182-8f53126223c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 22:27:12.358106 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a52d8999c0 pid: 116466 (default app) Jan 24 22:27:47.590041 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-21c94531-08f1-4fcd-826b-bbfbcaffcce4 tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] Action: 'create', calling method: .version_select at 0x7f7e5f14e9d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1001110464", "metadata": {"Type": "work"}}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:27:47.592571 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-21c94531-08f1-4fcd-826b-bbfbcaffcce4 tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:27:47.593707 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-21c94531-08f1-4fcd-826b-bbfbcaffcce4 tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.060666 Jan 24 22:27:47.599895 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 1/1] 10.222.0.84 () {60 vars in 1155 bytes} [Mon Jan 24 22:27:46 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1068 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 24 22:27:47.669440 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-9e6c97bc-71ca-4a08-a276-09b23cb1d492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-381990995", "imageRef": "4fe12948-6887-4759-900b-f3ee39409e75", "flavorRef": "452", "networks": [{"uuid": "e8ede52f-f77b-4695-9cf8-08051f1c017e"}]}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:27:47.806570 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-58d2d3f3-496b-41fc-96a2-147fb31b0eac tempest-VolumesGetTestJSON-4673384 tempest-VolumesGetTestJSON-4673384-project] Action: 'create', calling method: .version_select at 0x7f7e5f14b9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-43681765", "metadata": {"Type": "work"}}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:27:48.018379 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.network.neutron [None req-9e6c97bc-71ca-4a08-a276-09b23cb1d492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] validate_networks() for [('e8ede52f-f77b-4695-9cf8-08051f1c017e', None, None, None, None, None)] {{(pid=116466) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:27:48.584946 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-58d2d3f3-496b-41fc-96a2-147fb31b0eac tempest-VolumesGetTestJSON-4673384 tempest-VolumesGetTestJSON-4673384-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 2.176541 Jan 24 22:27:48.585621 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 1/2] 10.222.0.84 () {60 vars in 1155 bytes} [Mon Jan 24 22:27:46 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 2179 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 24 22:27:48.598588 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-77cc0f50-16d3-4a7e-890f-b99938fc0477 tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] Action: 'create', calling method: .version_select at 0x7f7e5f0ec550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1222255727", "metadata": {"Type": "work"}}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:27:48.605673 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-77cc0f50-16d3-4a7e-890f-b99938fc0477 tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:27:48.606767 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-77cc0f50-16d3-4a7e-890f-b99938fc0477 tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012551 Jan 24 22:27:48.607687 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 2/3] 10.222.0.84 () {60 vars in 1155 bytes} [Mon Jan 24 22:27:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 24 22:27:48.613711 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2f778068-0068-4fc8-9e4c-71e942d83514 tempest-VolumesGetTestJSON-4673384 tempest-VolumesGetTestJSON-4673384-project] Calling method '.version_select at 0x7f7e5f935040>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:48.774480 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2f778068-0068-4fc8-9e4c-71e942d83514 tempest-VolumesGetTestJSON-4673384 tempest-VolumesGetTestJSON-4673384-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/bd659066-2530-4bbd-8df2-fea354ceebb7" status: 200 len: 351 microversion: 2.1 time: 0.165346 Jan 24 22:27:48.775561 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 3/4] 10.222.0.84 () {58 vars in 1244 bytes} [Mon Jan 24 22:27:48 2022] GET /compute/v2.1/os-volumes/bd659066-2530-4bbd-8df2-fea354ceebb7 => generated 351 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:27:48.780440 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e2f50936-86cc-419e-b9f4-eb56a62f910a tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] Action: 'create', calling method: .version_select at 0x7f7e5f017790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-695433663", "metadata": {"Type": "work"}}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:27:48.784697 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e2f50936-86cc-419e-b9f4-eb56a62f910a tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:27:48.786021 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e2f50936-86cc-419e-b9f4-eb56a62f910a tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009316 Jan 24 22:27:48.788030 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 4/5] 10.222.0.84 () {60 vars in 1155 bytes} [Mon Jan 24 22:27:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 24 22:27:48.797081 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f46475a4-36bd-495b-8ba4-93fa6038ebf6 tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] Calling method '.version_select at 0x7f7e5efac8b0>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:48.830401 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-f46475a4-36bd-495b-8ba4-93fa6038ebf6 tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] HTTP exception thrown: Volume tempest-invalid-230158509 could not be found. Jan 24 22:27:48.831860 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f46475a4-36bd-495b-8ba4-93fa6038ebf6 tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] Returning 404 to user: Volume tempest-invalid-230158509 could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:27:48.833075 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-f46475a4-36bd-495b-8ba4-93fa6038ebf6 tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/tempest-invalid-230158509" status: 404 len: 98 microversion: 2.1 time: 0.039415 Jan 24 22:27:48.838525 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 5/6] 10.222.0.84 () {58 vars in 1214 bytes} [Mon Jan 24 22:27:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-230158509 => generated 98 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 24 22:27:48.843640 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-34999abb-2eb0-4fb6-b9fb-7c75d1668439 tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003493 Jan 24 22:27:48.844405 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 6/7] 10.222.0.84 () {58 vars in 1139 bytes} [Mon Jan 24 22:27:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 24 22:27:48.856737 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-89b65b35-bc5c-4fa2-8b54-71bef0f1e4be tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006007 Jan 24 22:27:48.857343 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 7/8] 10.222.0.84 () {58 vars in 1136 bytes} [Mon Jan 24 22:27:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 24 22:27:48.866712 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-eb9066c5-44ef-4618-b7f7-923fd562acec tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] Calling method '.version_select at 0x7f7e5f0178b0>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:48.924401 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-eb9066c5-44ef-4618-b7f7-923fd562acec tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] HTTP exception thrown: Volume 5babbd89-180a-4b8a-abd8-1d6a7d4e2842 could not be found. Jan 24 22:27:48.925216 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-eb9066c5-44ef-4618-b7f7-923fd562acec tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] Returning 404 to user: Volume 5babbd89-180a-4b8a-abd8-1d6a7d4e2842 could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:27:48.926486 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-eb9066c5-44ef-4618-b7f7-923fd562acec tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/5babbd89-180a-4b8a-abd8-1d6a7d4e2842" status: 404 len: 109 microversion: 2.1 time: 0.063907 Jan 24 22:27:48.927374 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 8/9] 10.222.0.84 () {58 vars in 1247 bytes} [Mon Jan 24 22:27:48 2022] DELETE /compute/v2.1/os-volumes/5babbd89-180a-4b8a-abd8-1d6a7d4e2842 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:27:48.937063 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4eb092f6-6f08-4a01-a0b7-434bcdb19dcc tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] Calling method '.version_select at 0x7f7e5f017b80>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:49.000200 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-4eb092f6-6f08-4a01-a0b7-434bcdb19dcc tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] HTTP exception thrown: Volume 18ebac13-27bf-4969-8638-cd5e629bb47f could not be found. Jan 24 22:27:49.000797 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4eb092f6-6f08-4a01-a0b7-434bcdb19dcc tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] Returning 404 to user: Volume 18ebac13-27bf-4969-8638-cd5e629bb47f could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:27:49.001662 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4eb092f6-6f08-4a01-a0b7-434bcdb19dcc tempest-VolumesNegativeTest-616429605 tempest-VolumesNegativeTest-616429605-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/18ebac13-27bf-4969-8638-cd5e629bb47f" status: 404 len: 109 microversion: 2.1 time: 0.068532 Jan 24 22:27:49.002221 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 9/10] 10.222.0.84 () {58 vars in 1244 bytes} [Mon Jan 24 22:27:48 2022] GET /compute/v2.1/os-volumes/18ebac13-27bf-4969-8638-cd5e629bb47f => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 24 22:27:49.252846 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-9e6c97bc-71ca-4a08-a276-09b23cb1d492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Flavor limits 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:27:49.253371 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-9e6c97bc-71ca-4a08-a276-09b23cb1d492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Image limits 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:27:49.254077 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-9e6c97bc-71ca-4a08-a276-09b23cb1d492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Flavor pref 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:27:49.254256 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-9e6c97bc-71ca-4a08-a276-09b23cb1d492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Image pref 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:27:49.254802 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-9e6c97bc-71ca-4a08-a276-09b23cb1d492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:27:49.283199 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9e6c97bc-71ca-4a08-a276-09b23cb1d492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:49.285265 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9e6c97bc-71ca-4a08-a276-09b23cb1d492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:49.288032 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9e6c97bc-71ca-4a08-a276-09b23cb1d492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:49.289442 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9e6c97bc-71ca-4a08-a276-09b23cb1d492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:49.355652 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-9e6c97bc-71ca-4a08-a276-09b23cb1d492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Getting quotas for project a78218846bb84713b4c02d9f95a25250. Resources: {'cores', 'instances', 'ram'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:27:49.363401 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-9e6c97bc-71ca-4a08-a276-09b23cb1d492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Getting quotas for user a0f51c8d0b8c4cc5ab76dae765c1b1c9 and project a78218846bb84713b4c02d9f95a25250. Resources: {'cores', 'instances', 'ram'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:27:49.378076 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-9e6c97bc-71ca-4a08-a276-09b23cb1d492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Going to run 1 instances... {{(pid=116466) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:27:49.381152 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-9e6c97bc-71ca-4a08-a276-09b23cb1d492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fe12948-6887-4759-900b-f3ee39409e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:27:49.486623 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-9e6c97bc-71ca-4a08-a276-09b23cb1d492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.884532 Jan 24 22:27:49.487938 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 2/11] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:27:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 24 22:27:49.498363 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-801f4f85-cd4e-42e1-8b19-f9db2c9f5492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:49.499974 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-801f4f85-cd4e-42e1-8b19-f9db2c9f5492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:27:49.730534 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-801f4f85-cd4e-42e1-8b19-f9db2c9f5492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:27:49.770614 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-801f4f85-cd4e-42e1-8b19-f9db2c9f5492 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1217 microversion: 2.1 time: 0.264355 Jan 24 22:27:49.788650 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-43013b8d-7e61-4211-aa1c-9e87799375a7 tempest-VolumesGetTestJSON-4673384 tempest-VolumesGetTestJSON-4673384-project] Calling method '.version_select at 0x7f7e5ef52310>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:49.813972 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 10/12] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:27:49 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1217 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:27:50.011293 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-43013b8d-7e61-4211-aa1c-9e87799375a7 tempest-VolumesGetTestJSON-4673384 tempest-VolumesGetTestJSON-4673384-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/bd659066-2530-4bbd-8df2-fea354ceebb7" status: 200 len: 352 microversion: 2.1 time: 0.226975 Jan 24 22:27:50.011863 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 3/13] 10.222.0.84 () {58 vars in 1244 bytes} [Mon Jan 24 22:27:49 2022] GET /compute/v2.1/os-volumes/bd659066-2530-4bbd-8df2-fea354ceebb7 => generated 352 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:27:50.024550 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-74a94ccb-cb56-471a-aa55-e2502b15503c tempest-VolumesGetTestJSON-4673384 tempest-VolumesGetTestJSON-4673384-project] Calling method '.version_select at 0x7f7e5efde280>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:50.124902 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-74a94ccb-cb56-471a-aa55-e2502b15503c tempest-VolumesGetTestJSON-4673384 tempest-VolumesGetTestJSON-4673384-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/bd659066-2530-4bbd-8df2-fea354ceebb7" status: 200 len: 352 microversion: 2.1 time: 0.105167 Jan 24 22:27:50.125621 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 11/14] 10.222.0.84 () {58 vars in 1244 bytes} [Mon Jan 24 22:27:50 2022] GET /compute/v2.1/os-volumes/bd659066-2530-4bbd-8df2-fea354ceebb7 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:27:50.157519 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c6e5d8b4-3197-410e-9e26-1b9b8e89c225 tempest-VolumesGetTestJSON-4673384 tempest-VolumesGetTestJSON-4673384-project] Calling method '.version_select at 0x7f7e5ef52f70>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:50.315026 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c6e5d8b4-3197-410e-9e26-1b9b8e89c225 tempest-VolumesGetTestJSON-4673384 tempest-VolumesGetTestJSON-4673384-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/bd659066-2530-4bbd-8df2-fea354ceebb7" status: 202 len: 0 microversion: 2.1 time: 0.172443 Jan 24 22:27:50.315851 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 4/15] 10.222.0.84 () {58 vars in 1247 bytes} [Mon Jan 24 22:27:50 2022] DELETE /compute/v2.1/os-volumes/bd659066-2530-4bbd-8df2-fea354ceebb7 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:27:50.324513 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-65b27506-9c70-4b24-ab12-875bc8b9d379 tempest-VolumesGetTestJSON-4673384 tempest-VolumesGetTestJSON-4673384-project] Calling method '.version_select at 0x7f7e5dec23a0>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:50.420032 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-65b27506-9c70-4b24-ab12-875bc8b9d379 tempest-VolumesGetTestJSON-4673384 tempest-VolumesGetTestJSON-4673384-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/bd659066-2530-4bbd-8df2-fea354ceebb7" status: 200 len: 351 microversion: 2.1 time: 0.099654 Jan 24 22:27:50.421216 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 5/16] 10.222.0.84 () {58 vars in 1244 bytes} [Mon Jan 24 22:27:50 2022] GET /compute/v2.1/os-volumes/bd659066-2530-4bbd-8df2-fea354ceebb7 => generated 351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:27:50.434020 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a318be94-fbb4-4025-9150-f85efb82b409 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1847293728", "imageRef": "4fe12948-6887-4759-900b-f3ee39409e75", "flavorRef": "452", "networks": [{"uuid": "03e6c4e1-e675-417e-a5db-954a15197bef"}]}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:27:50.556873 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.network.neutron [None req-a318be94-fbb4-4025-9150-f85efb82b409 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] validate_networks() for [('03e6c4e1-e675-417e-a5db-954a15197bef', None, None, None, None, None)] {{(pid=116467) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:27:50.787632 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-66d7bc02-d0df-4584-9be0-3fb1e2776016 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:50.788583 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-66d7bc02-d0df-4584-9be0-3fb1e2776016 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:27:51.099411 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-66d7bc02-d0df-4584-9be0-3fb1e2776016 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:27:51.152510 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-66d7bc02-d0df-4584-9be0-3fb1e2776016 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1217 microversion: 2.1 time: 0.366466 Jan 24 22:27:51.155868 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 6/17] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:27:50 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1217 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:27:51.435439 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-827c1866-718d-4fcb-b2ef-275da5846842 tempest-VolumesGetTestJSON-4673384 tempest-VolumesGetTestJSON-4673384-project] Calling method '.version_select at 0x7f7e5dec18b0>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:51.483307 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-827c1866-718d-4fcb-b2ef-275da5846842 tempest-VolumesGetTestJSON-4673384 tempest-VolumesGetTestJSON-4673384-project] HTTP exception thrown: Volume bd659066-2530-4bbd-8df2-fea354ceebb7 could not be found. Jan 24 22:27:51.485635 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-827c1866-718d-4fcb-b2ef-275da5846842 tempest-VolumesGetTestJSON-4673384 tempest-VolumesGetTestJSON-4673384-project] Returning 404 to user: Volume bd659066-2530-4bbd-8df2-fea354ceebb7 could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:27:51.486728 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-827c1866-718d-4fcb-b2ef-275da5846842 tempest-VolumesGetTestJSON-4673384 tempest-VolumesGetTestJSON-4673384-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/bd659066-2530-4bbd-8df2-fea354ceebb7" status: 404 len: 109 microversion: 2.1 time: 0.056785 Jan 24 22:27:51.487651 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 7/18] 10.222.0.84 () {58 vars in 1244 bytes} [Mon Jan 24 22:27:51 2022] GET /compute/v2.1/os-volumes/bd659066-2530-4bbd-8df2-fea354ceebb7 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:27:52.172801 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-eff83713-258a-4fde-87ca-cfbdc5457e72 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:52.173843 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-eff83713-258a-4fde-87ca-cfbdc5457e72 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:27:52.202298 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-eff83713-258a-4fde-87ca-cfbdc5457e72 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:52.202750 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-eff83713-258a-4fde-87ca-cfbdc5457e72 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:52.204657 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-eff83713-258a-4fde-87ca-cfbdc5457e72 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:52.205139 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-eff83713-258a-4fde-87ca-cfbdc5457e72 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:52.674115 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-eff83713-258a-4fde-87ca-cfbdc5457e72 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:27:52.675495 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-a318be94-fbb4-4025-9150-f85efb82b409 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Flavor limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:27:52.676015 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-a318be94-fbb4-4025-9150-f85efb82b409 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Image limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:27:52.676600 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-a318be94-fbb4-4025-9150-f85efb82b409 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Flavor pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:27:52.677170 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-a318be94-fbb4-4025-9150-f85efb82b409 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Image pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:27:52.678093 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-a318be94-fbb4-4025-9150-f85efb82b409 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:27:52.694053 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-eff83713-258a-4fde-87ca-cfbdc5457e72 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1269 microversion: 2.1 time: 0.525599 Jan 24 22:27:52.695178 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 8/19] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:27:52 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1269 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:27:52.730403 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a318be94-fbb4-4025-9150-f85efb82b409 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:52.731408 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a318be94-fbb4-4025-9150-f85efb82b409 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:52.732396 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a318be94-fbb4-4025-9150-f85efb82b409 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:52.733283 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a318be94-fbb4-4025-9150-f85efb82b409 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:52.811686 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-a318be94-fbb4-4025-9150-f85efb82b409 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Getting quotas for project 19ba1e1256864514ab790aa9db823338. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:27:52.831863 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-a318be94-fbb4-4025-9150-f85efb82b409 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Getting quotas for user caac87d558354fa188d16f131612030a and project 19ba1e1256864514ab790aa9db823338. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:27:52.851753 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a318be94-fbb4-4025-9150-f85efb82b409 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Going to run 1 instances... {{(pid=116467) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:27:52.854647 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a318be94-fbb4-4025-9150-f85efb82b409 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fe12948-6887-4759-900b-f3ee39409e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:27:53.062280 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a318be94-fbb4-4025-9150-f85efb82b409 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.897452 Jan 24 22:27:53.068859 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 12/20] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:27:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 24 22:27:53.079382 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c62de151-47a6-4ca5-b9c5-5c4ae8d520e1 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:53.080239 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c62de151-47a6-4ca5-b9c5-5c4ae8d520e1 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:27:53.213848 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c62de151-47a6-4ca5-b9c5-5c4ae8d520e1 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:27:53.226461 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c62de151-47a6-4ca5-b9c5-5c4ae8d520e1 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1215 microversion: 2.1 time: 0.152796 Jan 24 22:27:53.227033 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 9/21] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:27:53 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:27:53.713122 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-556759bd-7134-485a-a732-d15faae20478 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:53.713810 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-556759bd-7134-485a-a732-d15faae20478 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:27:53.728598 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-556759bd-7134-485a-a732-d15faae20478 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:53.733674 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-556759bd-7134-485a-a732-d15faae20478 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:53.739072 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-556759bd-7134-485a-a732-d15faae20478 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:53.739527 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-556759bd-7134-485a-a732-d15faae20478 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:54.118352 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-556759bd-7134-485a-a732-d15faae20478 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:27:54.153354 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-556759bd-7134-485a-a732-d15faae20478 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1269 microversion: 2.1 time: 0.445279 Jan 24 22:27:54.163063 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 13/22] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:27:53 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1269 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:27:54.244123 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-4486a382-a13b-4b7f-af8d-e5d3686142c8 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:54.245221 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-4486a382-a13b-4b7f-af8d-e5d3686142c8 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:27:54.406536 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-4486a382-a13b-4b7f-af8d-e5d3686142c8 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:27:54.431080 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-4486a382-a13b-4b7f-af8d-e5d3686142c8 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1215 microversion: 2.1 time: 0.175967 Jan 24 22:27:54.433101 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 10/23] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:27:54 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1215 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:27:55.172482 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3eaf2b17-461c-4c72-a9f5-543bd2a3362a tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:55.173724 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-3eaf2b17-461c-4c72-a9f5-543bd2a3362a tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:27:55.188761 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3eaf2b17-461c-4c72-a9f5-543bd2a3362a tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:55.189338 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3eaf2b17-461c-4c72-a9f5-543bd2a3362a tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:55.192048 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3eaf2b17-461c-4c72-a9f5-543bd2a3362a tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:55.194731 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3eaf2b17-461c-4c72-a9f5-543bd2a3362a tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:55.449320 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-89c3b718-2993-479d-ada4-9da52caaf52c tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:55.450016 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-89c3b718-2993-479d-ada4-9da52caaf52c tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:27:55.480417 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-89c3b718-2993-479d-ada4-9da52caaf52c tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:55.492550 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-89c3b718-2993-479d-ada4-9da52caaf52c tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:55.499667 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-89c3b718-2993-479d-ada4-9da52caaf52c tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:55.501603 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-89c3b718-2993-479d-ada4-9da52caaf52c tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:55.555145 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3eaf2b17-461c-4c72-a9f5-543bd2a3362a tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:27:55.562590 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-3eaf2b17-461c-4c72-a9f5-543bd2a3362a tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1269 microversion: 2.1 time: 0.396238 Jan 24 22:27:55.574660 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 14/24] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:27:55 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1269 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:27:56.114217 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-89c3b718-2993-479d-ada4-9da52caaf52c tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:27:56.136539 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-89c3b718-2993-479d-ada4-9da52caaf52c tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1219 microversion: 2.1 time: 0.692588 Jan 24 22:27:56.143303 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 11/25] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:27:55 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1219 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:27:56.581092 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-720e6eb7-4810-4007-9f6d-1631649ea981 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:56.581700 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-720e6eb7-4810-4007-9f6d-1631649ea981 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:27:56.601141 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-720e6eb7-4810-4007-9f6d-1631649ea981 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:56.601819 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-720e6eb7-4810-4007-9f6d-1631649ea981 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:56.602669 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-720e6eb7-4810-4007-9f6d-1631649ea981 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:56.609967 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-720e6eb7-4810-4007-9f6d-1631649ea981 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:56.846889 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-720e6eb7-4810-4007-9f6d-1631649ea981 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:27:56.854668 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-720e6eb7-4810-4007-9f6d-1631649ea981 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1275 microversion: 2.1 time: 0.277284 Jan 24 22:27:56.861737 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 15/26] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:27:56 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1275 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:27:57.155739 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ec9211d3-2d62-4aab-a6ac-2560a3e91c82 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:57.156329 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ec9211d3-2d62-4aab-a6ac-2560a3e91c82 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:27:57.166589 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ec9211d3-2d62-4aab-a6ac-2560a3e91c82 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:57.167040 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ec9211d3-2d62-4aab-a6ac-2560a3e91c82 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:57.167906 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ec9211d3-2d62-4aab-a6ac-2560a3e91c82 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:57.168362 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ec9211d3-2d62-4aab-a6ac-2560a3e91c82 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:57.878493 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-964d8ee1-fd37-4ce4-9ba7-b7cea6b463f8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:57.879313 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-964d8ee1-fd37-4ce4-9ba7-b7cea6b463f8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:27:57.891469 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-964d8ee1-fd37-4ce4-9ba7-b7cea6b463f8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:57.891602 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-964d8ee1-fd37-4ce4-9ba7-b7cea6b463f8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:57.892795 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-964d8ee1-fd37-4ce4-9ba7-b7cea6b463f8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:57.893249 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-964d8ee1-fd37-4ce4-9ba7-b7cea6b463f8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:57.940782 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ec9211d3-2d62-4aab-a6ac-2560a3e91c82 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:27:57.971581 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ec9211d3-2d62-4aab-a6ac-2560a3e91c82 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1273 microversion: 2.1 time: 0.804519 Jan 24 22:27:57.975782 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 12/27] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:27:57 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1273 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:27:58.994653 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-9ea0b7aa-62f8-4c0c-85b5-c3b3df8532b6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:27:58.995475 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-9ea0b7aa-62f8-4c0c-85b5-c3b3df8532b6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:27:59.002556 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9ea0b7aa-62f8-4c0c-85b5-c3b3df8532b6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:59.011921 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9ea0b7aa-62f8-4c0c-85b5-c3b3df8532b6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:59.012950 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9ea0b7aa-62f8-4c0c-85b5-c3b3df8532b6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:27:59.015256 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9ea0b7aa-62f8-4c0c-85b5-c3b3df8532b6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:27:59.731218 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-964d8ee1-fd37-4ce4-9ba7-b7cea6b463f8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:27:59.744146 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-964d8ee1-fd37-4ce4-9ba7-b7cea6b463f8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1275 microversion: 2.1 time: 1.869536 Jan 24 22:27:59.746153 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 16/28] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:27:57 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1275 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:28:00.649975 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-9ea0b7aa-62f8-4c0c-85b5-c3b3df8532b6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:00.659238 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-9ea0b7aa-62f8-4c0c-85b5-c3b3df8532b6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1273 microversion: 2.1 time: 1.668615 Jan 24 22:28:00.668253 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 13/29] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:27:58 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1273 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:00.765174 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-278551cc-18d3-4fef-aea4-aff4a0221f1b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:00.765960 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-278551cc-18d3-4fef-aea4-aff4a0221f1b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:00.779307 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-278551cc-18d3-4fef-aea4-aff4a0221f1b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:00.779757 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-278551cc-18d3-4fef-aea4-aff4a0221f1b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:00.780552 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-278551cc-18d3-4fef-aea4-aff4a0221f1b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:00.784310 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-278551cc-18d3-4fef-aea4-aff4a0221f1b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:00.949700 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-278551cc-18d3-4fef-aea4-aff4a0221f1b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:00.958792 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-278551cc-18d3-4fef-aea4-aff4a0221f1b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1275 microversion: 2.1 time: 0.199418 Jan 24 22:28:00.974573 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 17/30] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:00 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1275 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:01.700033 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-4b9bbc2a-e658-4a8a-8ae7-54a07db51fef tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:01.700716 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-4b9bbc2a-e658-4a8a-8ae7-54a07db51fef tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:01.712212 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4b9bbc2a-e658-4a8a-8ae7-54a07db51fef tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:01.712973 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4b9bbc2a-e658-4a8a-8ae7-54a07db51fef tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:01.714249 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4b9bbc2a-e658-4a8a-8ae7-54a07db51fef tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:01.714826 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4b9bbc2a-e658-4a8a-8ae7-54a07db51fef tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:01.982331 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f5c9fc38-666f-46b5-80c4-d22870a942f9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:01.983517 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-f5c9fc38-666f-46b5-80c4-d22870a942f9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:01.994482 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f5c9fc38-666f-46b5-80c4-d22870a942f9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:01.998829 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f5c9fc38-666f-46b5-80c4-d22870a942f9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:01.999878 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f5c9fc38-666f-46b5-80c4-d22870a942f9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:02.001910 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f5c9fc38-666f-46b5-80c4-d22870a942f9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:02.480780 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-f5c9fc38-666f-46b5-80c4-d22870a942f9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:02.488722 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-f5c9fc38-666f-46b5-80c4-d22870a942f9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1275 microversion: 2.1 time: 0.510380 Jan 24 22:28:02.498010 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 18/31] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:01 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1275 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:03.005680 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1e9f4b4e-b8a5-4441-abaf-cdca2d137840 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'create', calling method: .version_select at 0x7f7e5de58d30>, body: {"keypair": {"name": "tempest-keypair-1162611317"}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:03.081370 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-1e9f4b4e-b8a5-4441-abaf-cdca2d137840 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Getting quotas for project 971e5fb7e6884a74947db35700479fea. Resources: {'key_pairs'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:28:03.087485 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-1e9f4b4e-b8a5-4441-abaf-cdca2d137840 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Getting quotas for user d96fc7e81114482c8149bb10fa4d6cf0 and project 971e5fb7e6884a74947db35700479fea. Resources: {'key_pairs'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:28:03.697971 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-4b9bbc2a-e658-4a8a-8ae7-54a07db51fef tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:03.705511 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-4b9bbc2a-e658-4a8a-8ae7-54a07db51fef tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1315 microversion: 2.1 time: 2.023497 Jan 24 22:28:03.715684 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 14/32] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:01 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1315 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:03.759024 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-1e9f4b4e-b8a5-4441-abaf-cdca2d137840 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Getting quotas for project 971e5fb7e6884a74947db35700479fea. Resources: {'key_pairs'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:28:03.771430 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-1e9f4b4e-b8a5-4441-abaf-cdca2d137840 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Getting quotas for user d96fc7e81114482c8149bb10fa4d6cf0 and project 971e5fb7e6884a74947db35700479fea. Resources: {'key_pairs'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:28:03.806894 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1e9f4b4e-b8a5-4441-abaf-cdca2d137840 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.215325 Jan 24 22:28:03.816051 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 19/33] 10.222.0.84 () {60 vars in 1157 bytes} [Mon Jan 24 22:28:02 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:03.829304 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0ae3d144-0f83-4a3f-af1a-aff43c87c55c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:03.829973 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0ae3d144-0f83-4a3f-af1a-aff43c87c55c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:03.852489 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0ae3d144-0f83-4a3f-af1a-aff43c87c55c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:03.858701 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0ae3d144-0f83-4a3f-af1a-aff43c87c55c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:03.859682 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0ae3d144-0f83-4a3f-af1a-aff43c87c55c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:03.860124 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0ae3d144-0f83-4a3f-af1a-aff43c87c55c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:04.131704 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-fec80407-c8cf-4e40-af28-734724710063 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'create', calling method: .version_select at 0x7f7e5f0469d0>, body: {"keypair": {"name": "tempest-keypair-218249340"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:04.200959 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-fec80407-c8cf-4e40-af28-734724710063 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Getting quotas for project 2480860d99554b1c8d0c7845602c854e. Resources: {'key_pairs'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:28:04.206412 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-fec80407-c8cf-4e40-af28-734724710063 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Getting quotas for user e3e0792aba0a4e12bc29eceb648916eb and project 2480860d99554b1c8d0c7845602c854e. Resources: {'key_pairs'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:28:04.793238 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-fec80407-c8cf-4e40-af28-734724710063 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Getting quotas for project 2480860d99554b1c8d0c7845602c854e. Resources: {'key_pairs'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:28:04.806969 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-fec80407-c8cf-4e40-af28-734724710063 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Getting quotas for user e3e0792aba0a4e12bc29eceb648916eb and project 2480860d99554b1c8d0c7845602c854e. Resources: {'key_pairs'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:28:04.851708 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-fec80407-c8cf-4e40-af28-734724710063 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.134503 Jan 24 22:28:04.853070 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 15/34] 10.222.0.84 () {62 vars in 1198 bytes} [Mon Jan 24 22:28:03 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1139 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 24 22:28:04.863370 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7262fde2-f9a5-4bf8-b6c1-992e5f1db388 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:04.864383 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7262fde2-f9a5-4bf8-b6c1-992e5f1db388 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:04.882477 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7262fde2-f9a5-4bf8-b6c1-992e5f1db388 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:04.883178 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7262fde2-f9a5-4bf8-b6c1-992e5f1db388 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:04.884144 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7262fde2-f9a5-4bf8-b6c1-992e5f1db388 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:04.884587 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7262fde2-f9a5-4bf8-b6c1-992e5f1db388 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:06.144699 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0ae3d144-0f83-4a3f-af1a-aff43c87c55c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:06.156555 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0ae3d144-0f83-4a3f-af1a-aff43c87c55c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 2.336106 Jan 24 22:28:06.157242 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 20/35] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:03 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:07.178870 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ab4004e6-736a-4a93-844b-d8335f6e1790 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:07.179999 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ab4004e6-736a-4a93-844b-d8335f6e1790 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:07.203796 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ab4004e6-736a-4a93-844b-d8335f6e1790 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:07.211013 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ab4004e6-736a-4a93-844b-d8335f6e1790 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:07.218704 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ab4004e6-736a-4a93-844b-d8335f6e1790 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:07.222532 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ab4004e6-736a-4a93-844b-d8335f6e1790 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:07.273509 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7262fde2-f9a5-4bf8-b6c1-992e5f1db388 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:07.283740 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7262fde2-f9a5-4bf8-b6c1-992e5f1db388 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1315 microversion: 2.1 time: 2.429328 Jan 24 22:28:07.290378 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 16/36] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:04 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1315 bytes in 2436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:08.313949 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-328d6b9a-d057-4904-b0d7-dd4e17d6a90f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:08.317029 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-328d6b9a-d057-4904-b0d7-dd4e17d6a90f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:08.329548 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-328d6b9a-d057-4904-b0d7-dd4e17d6a90f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:08.330268 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-328d6b9a-d057-4904-b0d7-dd4e17d6a90f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:08.331503 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-328d6b9a-d057-4904-b0d7-dd4e17d6a90f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:08.332116 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-328d6b9a-d057-4904-b0d7-dd4e17d6a90f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:10.331234 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ab4004e6-736a-4a93-844b-d8335f6e1790 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:10.343408 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ab4004e6-736a-4a93-844b-d8335f6e1790 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 3.172654 Jan 24 22:28:10.345985 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 21/37] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:07 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 3177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:28:10.365442 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9de672f9-93db-41c8-b090-e6907601e483 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-207277660", "imageRef": "4fe12948-6887-4759-900b-f3ee39409e75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6dcc1b10-df2b-4c1c-b91e-fb189e3895c8"}], "security_groups": [{"name": "tempest-securitygroup--611951808"}], "key_name": "tempest-keypair-1162611317", "user_data": "}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:11.258138 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.network.neutron [None req-9de672f9-93db-41c8-b090-e6907601e483 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] validate_networks() for [('6dcc1b10-df2b-4c1c-b91e-fb189e3895c8', None, None, None, None, None)] {{(pid=116467) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:28:11.274396 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-328d6b9a-d057-4904-b0d7-dd4e17d6a90f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:11.299915 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-328d6b9a-d057-4904-b0d7-dd4e17d6a90f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1315 microversion: 2.1 time: 2.997948 Jan 24 22:28:11.335922 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 17/38] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:08 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1315 bytes in 3035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:11.362927 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b1c3dbc1-7f4b-4a84-a3c8-6621c0231a0f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:11.363550 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b1c3dbc1-7f4b-4a84-a3c8-6621c0231a0f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:11.406100 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b1c3dbc1-7f4b-4a84-a3c8-6621c0231a0f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:11.411262 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b1c3dbc1-7f4b-4a84-a3c8-6621c0231a0f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:11.420610 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b1c3dbc1-7f4b-4a84-a3c8-6621c0231a0f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:11.422238 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b1c3dbc1-7f4b-4a84-a3c8-6621c0231a0f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:12.463074 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b1c3dbc1-7f4b-4a84-a3c8-6621c0231a0f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:12.473010 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b1c3dbc1-7f4b-4a84-a3c8-6621c0231a0f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 1.115667 Jan 24 22:28:12.473832 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 18/39] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:11 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:28:12.481900 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3a5a10c1-1414-425b-8c85-9c0c76aa009d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-8742336", "imageRef": "4fe12948-6887-4759-900b-f3ee39409e75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d56f692-32cb-491f-92de-425cd4663a5e"}], "security_groups": [{"name": "tempest-securitygroup--1466548807"}], "key_name": "tempest-keypair-218249340", "user_data": "}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:12.825229 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.network.neutron [None req-3a5a10c1-1414-425b-8c85-9c0c76aa009d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] validate_networks() for [('8d56f692-32cb-491f-92de-425cd4663a5e', None, None, None, None, None)] {{(pid=116466) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:28:13.515288 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-9de672f9-93db-41c8-b090-e6907601e483 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Flavor limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:28:13.516305 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-9de672f9-93db-41c8-b090-e6907601e483 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Image limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:28:13.517304 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-9de672f9-93db-41c8-b090-e6907601e483 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Flavor pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:28:13.517873 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-9de672f9-93db-41c8-b090-e6907601e483 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Image pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:28:13.518701 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-9de672f9-93db-41c8-b090-e6907601e483 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:28:13.528638 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9de672f9-93db-41c8-b090-e6907601e483 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:13.529296 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9de672f9-93db-41c8-b090-e6907601e483 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:13.530198 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9de672f9-93db-41c8-b090-e6907601e483 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:13.530550 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9de672f9-93db-41c8-b090-e6907601e483 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:13.554633 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-9de672f9-93db-41c8-b090-e6907601e483 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Getting quotas for project 971e5fb7e6884a74947db35700479fea. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:28:13.558757 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-9de672f9-93db-41c8-b090-e6907601e483 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Getting quotas for user d96fc7e81114482c8149bb10fa4d6cf0 and project 971e5fb7e6884a74947db35700479fea. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:28:13.571390 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9de672f9-93db-41c8-b090-e6907601e483 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Going to run 1 instances... {{(pid=116467) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:28:13.573918 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9de672f9-93db-41c8-b090-e6907601e483 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fe12948-6887-4759-900b-f3ee39409e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:28:13.659784 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9de672f9-93db-41c8-b090-e6907601e483 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.309788 Jan 24 22:28:13.663790 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 22/40] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:28:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 3317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 24 22:28:13.916338 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-92f48634-df28-434f-86c4-c5b94a25c87c req-a25c64a4-9bf4-46ee-9a03-0cc5d5b79f03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179be558-5543-42db-b299-8115c58cf1e5", "tag": "0843b280-c8c5-4405-93c7-2ba198e91f41"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:13.919116 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:28:13.919116 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:28:13.930909 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-92f48634-df28-434f-86c4-c5b94a25c87c req-a25c64a4-9bf4-46ee-9a03-0cc5d5b79f03 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:13.931595 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-92f48634-df28-434f-86c4-c5b94a25c87c req-a25c64a4-9bf4-46ee-9a03-0cc5d5b79f03 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:13.954224 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-92f48634-df28-434f-86c4-c5b94a25c87c req-a25c64a4-9bf4-46ee-9a03-0cc5d5b79f03 service nova] Creating event network-changed:0843b280-c8c5-4405-93c7-2ba198e91f41 for instance 179be558-5543-42db-b299-8115c58cf1e5 on hv-cinder-81322 Jan 24 22:28:13.954887 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-92f48634-df28-434f-86c4-c5b94a25c87c req-a25c64a4-9bf4-46ee-9a03-0cc5d5b79f03 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116467) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 24 22:28:13.956362 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4304d0ae-dc80-4738-be4c-bd03a679356b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:13.965582 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4304d0ae-dc80-4738-be4c-bd03a679356b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:13.965582 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4304d0ae-dc80-4738-be4c-bd03a679356b None None] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:13.965582 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4304d0ae-dc80-4738-be4c-bd03a679356b None None] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:13.970791 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.compute.rpcapi [None req-4304d0ae-dc80-4738-be4c-bd03a679356b None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 24 22:28:13.971766 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4304d0ae-dc80-4738-be4c-bd03a679356b None None] Releasing lock "compute-rpcapi-router" {{(pid=116467) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 24 22:28:14.015449 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4304d0ae-dc80-4738-be4c-bd03a679356b None None] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.348315 Jan 24 22:28:14.016430 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 23/41] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:28:14.029894 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-7ef1cc24-61a0-46d4-a878-643726206519 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:14.030610 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-7ef1cc24-61a0-46d4-a878-643726206519 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:14.040598 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7ef1cc24-61a0-46d4-a878-643726206519 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:14.041243 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7ef1cc24-61a0-46d4-a878-643726206519 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:14.042804 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7ef1cc24-61a0-46d4-a878-643726206519 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:14.045594 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7ef1cc24-61a0-46d4-a878-643726206519 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:14.331975 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-3a5a10c1-1414-425b-8c85-9c0c76aa009d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Flavor limits 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:28:14.333319 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-3a5a10c1-1414-425b-8c85-9c0c76aa009d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Image limits 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:28:14.333319 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-3a5a10c1-1414-425b-8c85-9c0c76aa009d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Flavor pref 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:28:14.333809 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-3a5a10c1-1414-425b-8c85-9c0c76aa009d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Image pref 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:28:14.334387 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-3a5a10c1-1414-425b-8c85-9c0c76aa009d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:28:14.356243 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3a5a10c1-1414-425b-8c85-9c0c76aa009d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:14.360769 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3a5a10c1-1414-425b-8c85-9c0c76aa009d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:14.363159 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3a5a10c1-1414-425b-8c85-9c0c76aa009d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:14.363609 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3a5a10c1-1414-425b-8c85-9c0c76aa009d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:14.400948 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-3a5a10c1-1414-425b-8c85-9c0c76aa009d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Getting quotas for project 2480860d99554b1c8d0c7845602c854e. Resources: {'cores', 'instances', 'ram'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:28:14.406881 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-3a5a10c1-1414-425b-8c85-9c0c76aa009d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Getting quotas for user e3e0792aba0a4e12bc29eceb648916eb and project 2480860d99554b1c8d0c7845602c854e. Resources: {'cores', 'instances', 'ram'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:28:14.423916 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3a5a10c1-1414-425b-8c85-9c0c76aa009d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Going to run 1 instances... {{(pid=116466) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:28:14.426734 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3a5a10c1-1414-425b-8c85-9c0c76aa009d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fe12948-6887-4759-900b-f3ee39409e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:28:14.495315 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3a5a10c1-1414-425b-8c85-9c0c76aa009d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.019829 Jan 24 22:28:14.497108 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 19/42] 10.222.0.84 () {62 vars in 1187 bytes} [Mon Jan 24 22:28:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 2022 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 24 22:28:14.507811 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-4f360198-778d-4cf2-bff0-798354201de7 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:14.508849 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-4f360198-778d-4cf2-bff0-798354201de7 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:14.520969 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4f360198-778d-4cf2-bff0-798354201de7 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:14.522479 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4f360198-778d-4cf2-bff0-798354201de7 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:14.524657 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4f360198-778d-4cf2-bff0-798354201de7 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:14.525900 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4f360198-778d-4cf2-bff0-798354201de7 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:14.544352 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7ef1cc24-61a0-46d4-a878-643726206519 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:14.570502 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-7ef1cc24-61a0-46d4-a878-643726206519 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1315 microversion: 2.1 time: 0.551009 Jan 24 22:28:14.571473 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 24/43] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:14 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:14.581534 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6c372ff0-ad1f-45ed-aa25-4ad971c2a191 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:14.582692 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6c372ff0-ad1f-45ed-aa25-4ad971c2a191 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:14.598466 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6c372ff0-ad1f-45ed-aa25-4ad971c2a191 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:14.599579 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6c372ff0-ad1f-45ed-aa25-4ad971c2a191 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:14.600904 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6c372ff0-ad1f-45ed-aa25-4ad971c2a191 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:14.601742 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6c372ff0-ad1f-45ed-aa25-4ad971c2a191 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:14.792920 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6c372ff0-ad1f-45ed-aa25-4ad971c2a191 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:14.803139 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6c372ff0-ad1f-45ed-aa25-4ad971c2a191 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1241 microversion: 2.1 time: 0.229813 Jan 24 22:28:14.817516 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 25/44] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:14 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1241 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:14.914007 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c07f6aa4-0ddd-4f9c-942c-9342b167900c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-675109505", "imageRef": "4fe12948-6887-4759-900b-f3ee39409e75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:15.040296 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.network.neutron [None req-c07f6aa4-0ddd-4f9c-942c-9342b167900c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] validate_networks() for [('a7842576-11ac-466b-b3df-3ae9b0fa5bfa', None, None, None, None, None)] {{(pid=116467) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:28:15.192421 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-4f360198-778d-4cf2-bff0-798354201de7 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:15.200628 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-4f360198-778d-4cf2-bff0-798354201de7 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 0.702164 Jan 24 22:28:15.206868 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 20/45] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:14 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:15.215840 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-04e2c149-4ce2-4d3c-b2c6-5d15a49580be tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:15.218449 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-04e2c149-4ce2-4d3c-b2c6-5d15a49580be tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:15.322868 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-04e2c149-4ce2-4d3c-b2c6-5d15a49580be tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:15.332307 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-04e2c149-4ce2-4d3c-b2c6-5d15a49580be tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:15.338693 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-04e2c149-4ce2-4d3c-b2c6-5d15a49580be tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:15.341161 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-04e2c149-4ce2-4d3c-b2c6-5d15a49580be tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1278 microversion: 2.20 time: 0.133128 Jan 24 22:28:15.342902 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 21/46] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:15 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1278 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:15.587941 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-19056c82-63bb-4b16-8c13-5d7175b2b0ef tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:15.588698 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-19056c82-63bb-4b16-8c13-5d7175b2b0ef tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:15.616183 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19056c82-63bb-4b16-8c13-5d7175b2b0ef tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:15.616676 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19056c82-63bb-4b16-8c13-5d7175b2b0ef tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:15.617564 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19056c82-63bb-4b16-8c13-5d7175b2b0ef tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:15.620740 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19056c82-63bb-4b16-8c13-5d7175b2b0ef tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:16.106985 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-19056c82-63bb-4b16-8c13-5d7175b2b0ef tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:16.117833 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-19056c82-63bb-4b16-8c13-5d7175b2b0ef tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1315 microversion: 2.1 time: 0.533586 Jan 24 22:28:16.129698 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 22/47] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:15 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:28:16.138093 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-682a25cf-0b9d-4f43-9015-d3311b2d469a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:16.139154 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-682a25cf-0b9d-4f43-9015-d3311b2d469a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:16.150063 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-682a25cf-0b9d-4f43-9015-d3311b2d469a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:16.151228 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-682a25cf-0b9d-4f43-9015-d3311b2d469a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:16.153133 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-682a25cf-0b9d-4f43-9015-d3311b2d469a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:16.167018 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-682a25cf-0b9d-4f43-9015-d3311b2d469a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:16.369205 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-682a25cf-0b9d-4f43-9015-d3311b2d469a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:16.381216 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-682a25cf-0b9d-4f43-9015-d3311b2d469a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1295 microversion: 2.1 time: 0.249828 Jan 24 22:28:16.382231 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 23/48] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:16 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1295 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:16.394077 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-f976d926-f101-4966-b2dc-c1a15cd1a1b9 req-d171badb-3cef-4e00-8553-a65efd17f6bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33400f7e-6413-4b0d-8062-8c4befff1b88", "tag": "a2470f65-0c4d-4ecd-a4b6-9d25e27a0c99"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:16.402924 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:28:16.402924 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:28:16.429775 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-f976d926-f101-4966-b2dc-c1a15cd1a1b9 req-d171badb-3cef-4e00-8553-a65efd17f6bf service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:16.437118 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-f976d926-f101-4966-b2dc-c1a15cd1a1b9 req-d171badb-3cef-4e00-8553-a65efd17f6bf service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:16.492538 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-f976d926-f101-4966-b2dc-c1a15cd1a1b9 req-d171badb-3cef-4e00-8553-a65efd17f6bf service nova] Creating event network-changed:a2470f65-0c4d-4ecd-a4b6-9d25e27a0c99 for instance 33400f7e-6413-4b0d-8062-8c4befff1b88 on hv-cinder-81322 Jan 24 22:28:16.493558 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-f976d926-f101-4966-b2dc-c1a15cd1a1b9 req-d171badb-3cef-4e00-8553-a65efd17f6bf service nova] Acquired lock "compute-rpcapi-router" {{(pid=116466) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 24 22:28:16.495952 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-26596eca-abd3-4ed4-9819-0a5725b68816 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:16.496647 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-26596eca-abd3-4ed4-9819-0a5725b68816 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:16.497753 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-26596eca-abd3-4ed4-9819-0a5725b68816 None None] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:16.498866 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-26596eca-abd3-4ed4-9819-0a5725b68816 None None] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:16.514550 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.compute.rpcapi [None req-26596eca-abd3-4ed4-9819-0a5725b68816 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 24 22:28:16.518087 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-26596eca-abd3-4ed4-9819-0a5725b68816 None None] Releasing lock "compute-rpcapi-router" {{(pid=116466) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 24 22:28:16.556388 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-26596eca-abd3-4ed4-9819-0a5725b68816 None None] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169644 Jan 24 22:28:16.557030 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 24/49] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:28:16.563907 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b13f6d8b-1771-405c-82ba-e73367668943 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:16.564616 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b13f6d8b-1771-405c-82ba-e73367668943 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:16.582718 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b13f6d8b-1771-405c-82ba-e73367668943 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:16.584239 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b13f6d8b-1771-405c-82ba-e73367668943 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:16.584239 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b13f6d8b-1771-405c-82ba-e73367668943 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:16.584511 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b13f6d8b-1771-405c-82ba-e73367668943 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:16.636843 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-c07f6aa4-0ddd-4f9c-942c-9342b167900c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Flavor limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:28:16.638080 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-c07f6aa4-0ddd-4f9c-942c-9342b167900c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Image limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:28:16.638714 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-c07f6aa4-0ddd-4f9c-942c-9342b167900c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Flavor pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:28:16.639404 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-c07f6aa4-0ddd-4f9c-942c-9342b167900c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Image pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:28:16.640297 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-c07f6aa4-0ddd-4f9c-942c-9342b167900c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:28:16.658017 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c07f6aa4-0ddd-4f9c-942c-9342b167900c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:16.658665 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c07f6aa4-0ddd-4f9c-942c-9342b167900c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:16.661761 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c07f6aa4-0ddd-4f9c-942c-9342b167900c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:16.671043 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c07f6aa4-0ddd-4f9c-942c-9342b167900c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:16.765961 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-c07f6aa4-0ddd-4f9c-942c-9342b167900c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Getting quotas for project 7e8dce58932149cbaee5ed5aabdbe3fa. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:28:16.787667 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-c07f6aa4-0ddd-4f9c-942c-9342b167900c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Getting quotas for user aef8ec94a2e64529ac89b22625a888c1 and project 7e8dce58932149cbaee5ed5aabdbe3fa. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:28:16.807906 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c07f6aa4-0ddd-4f9c-942c-9342b167900c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Going to run 1 instances... {{(pid=116467) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:28:16.810823 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c07f6aa4-0ddd-4f9c-942c-9342b167900c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fe12948-6887-4759-900b-f3ee39409e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:28:17.058332 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c07f6aa4-0ddd-4f9c-942c-9342b167900c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.235743 Jan 24 22:28:17.059635 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 26/50] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:28:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 24 22:28:17.084109 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-41fb0761-164d-4cc0-acfd-5ab7056bbbe2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:17.088225 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-41fb0761-164d-4cc0-acfd-5ab7056bbbe2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:17.139064 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-41fb0761-164d-4cc0-acfd-5ab7056bbbe2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:17.141258 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-41fb0761-164d-4cc0-acfd-5ab7056bbbe2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:17.143685 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-41fb0761-164d-4cc0-acfd-5ab7056bbbe2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:17.144500 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-41fb0761-164d-4cc0-acfd-5ab7056bbbe2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:17.436622 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-41fb0761-164d-4cc0-acfd-5ab7056bbbe2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:17.449095 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-41fb0761-164d-4cc0-acfd-5ab7056bbbe2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:17.454499 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-41fb0761-164d-4cc0-acfd-5ab7056bbbe2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:17.460599 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-41fb0761-164d-4cc0-acfd-5ab7056bbbe2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1336 microversion: 2.20 time: 0.397812 Jan 24 22:28:17.471862 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 27/51] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:17 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1336 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:17.478484 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a24aec84-ef30-4259-b257-5233d92510d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:17.479089 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a24aec84-ef30-4259-b257-5233d92510d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:17.572280 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b13f6d8b-1771-405c-82ba-e73367668943 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:17.615911 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b13f6d8b-1771-405c-82ba-e73367668943 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 1.057463 Jan 24 22:28:17.616851 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 25/52] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:16 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:17.628944 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-0fa51748-60a0-4f50-a839-ccd1d29a00bb tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:17.629830 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-0fa51748-60a0-4f50-a839-ccd1d29a00bb tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:17.648073 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0fa51748-60a0-4f50-a839-ccd1d29a00bb tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:17.648876 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0fa51748-60a0-4f50-a839-ccd1d29a00bb tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:17.649723 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0fa51748-60a0-4f50-a839-ccd1d29a00bb tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:17.650172 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0fa51748-60a0-4f50-a839-ccd1d29a00bb tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:18.050987 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a24aec84-ef30-4259-b257-5233d92510d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:18.060355 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a24aec84-ef30-4259-b257-5233d92510d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1221 microversion: 2.1 time: 0.586565 Jan 24 22:28:18.060957 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 28/53] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:17 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1221 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:18.109874 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b18ba835-d959-4cd0-a82b-0c19e2e321d2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:18.110519 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b18ba835-d959-4cd0-a82b-0c19e2e321d2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:18.138777 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b18ba835-d959-4cd0-a82b-0c19e2e321d2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:18.140755 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b18ba835-d959-4cd0-a82b-0c19e2e321d2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:18.143711 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b18ba835-d959-4cd0-a82b-0c19e2e321d2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:18.145537 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b18ba835-d959-4cd0-a82b-0c19e2e321d2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:18.339939 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b18ba835-d959-4cd0-a82b-0c19e2e321d2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:18.359273 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b18ba835-d959-4cd0-a82b-0c19e2e321d2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1295 microversion: 2.1 time: 0.255727 Jan 24 22:28:18.369036 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 29/54] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:18 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1295 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:18.370929 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6ac00754-5313-4e07-857a-f9d39053b20f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1125037842", "imageRef": "4fe12948-6887-4759-900b-f3ee39409e75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:18.446300 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.network.neutron [None req-6ac00754-5313-4e07-857a-f9d39053b20f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] validate_networks() for [('a7842576-11ac-466b-b3df-3ae9b0fa5bfa', None, None, None, None, None)] {{(pid=116467) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:28:18.831963 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-0fa51748-60a0-4f50-a839-ccd1d29a00bb tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:18.845610 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-0fa51748-60a0-4f50-a839-ccd1d29a00bb tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1315 microversion: 2.1 time: 1.227344 Jan 24 22:28:18.846265 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 26/55] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:17 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1315 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:18.856917 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-0041356a-9363-438b-a524-34d5f6034843 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:18.857575 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-0041356a-9363-438b-a524-34d5f6034843 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:18.868707 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0041356a-9363-438b-a524-34d5f6034843 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:18.869180 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0041356a-9363-438b-a524-34d5f6034843 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:18.869964 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0041356a-9363-438b-a524-34d5f6034843 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:18.870396 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0041356a-9363-438b-a524-34d5f6034843 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:19.452926 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-0041356a-9363-438b-a524-34d5f6034843 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:19.469889 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-0041356a-9363-438b-a524-34d5f6034843 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:19.475722 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-0041356a-9363-438b-a524-34d5f6034843 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:19.478724 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-0041356a-9363-438b-a524-34d5f6034843 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1336 microversion: 2.20 time: 0.631494 Jan 24 22:28:19.480295 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 27/56] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:18 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1336 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:19.485089 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8048fa5b-da73-4637-ad48-a90dd673382f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:19.492165 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8048fa5b-da73-4637-ad48-a90dd673382f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:19.502012 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8048fa5b-da73-4637-ad48-a90dd673382f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:19.503631 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8048fa5b-da73-4637-ad48-a90dd673382f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:19.505360 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8048fa5b-da73-4637-ad48-a90dd673382f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:19.506436 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8048fa5b-da73-4637-ad48-a90dd673382f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:20.165732 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-8048fa5b-da73-4637-ad48-a90dd673382f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:20.176080 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8048fa5b-da73-4637-ad48-a90dd673382f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 0.691665 Jan 24 22:28:20.177208 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 28/57] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:19 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:20.188928 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a6253d5d-49c2-4683-8d19-ea3cdd4c7d1c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:20.189842 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a6253d5d-49c2-4683-8d19-ea3cdd4c7d1c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:20.205097 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a6253d5d-49c2-4683-8d19-ea3cdd4c7d1c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:20.206578 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a6253d5d-49c2-4683-8d19-ea3cdd4c7d1c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:20.207604 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a6253d5d-49c2-4683-8d19-ea3cdd4c7d1c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:20.209436 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a6253d5d-49c2-4683-8d19-ea3cdd4c7d1c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:20.264228 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-6ac00754-5313-4e07-857a-f9d39053b20f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Flavor limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:28:20.265209 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-6ac00754-5313-4e07-857a-f9d39053b20f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Image limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:28:20.265827 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-6ac00754-5313-4e07-857a-f9d39053b20f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Flavor pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:28:20.266801 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-6ac00754-5313-4e07-857a-f9d39053b20f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Image pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:28:20.267356 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-6ac00754-5313-4e07-857a-f9d39053b20f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:28:20.279718 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6ac00754-5313-4e07-857a-f9d39053b20f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:20.280673 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6ac00754-5313-4e07-857a-f9d39053b20f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:20.283220 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6ac00754-5313-4e07-857a-f9d39053b20f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:20.283976 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6ac00754-5313-4e07-857a-f9d39053b20f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:20.309611 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-6ac00754-5313-4e07-857a-f9d39053b20f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Getting quotas for project 7e8dce58932149cbaee5ed5aabdbe3fa. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:28:20.314914 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-6ac00754-5313-4e07-857a-f9d39053b20f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Getting quotas for user aef8ec94a2e64529ac89b22625a888c1 and project 7e8dce58932149cbaee5ed5aabdbe3fa. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:28:20.336525 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6ac00754-5313-4e07-857a-f9d39053b20f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Going to run 1 instances... {{(pid=116467) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:28:20.339480 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6ac00754-5313-4e07-857a-f9d39053b20f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fe12948-6887-4759-900b-f3ee39409e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:28:20.403636 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6ac00754-5313-4e07-857a-f9d39053b20f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.041858 Jan 24 22:28:20.409226 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 30/58] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:28:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 24 22:28:20.414879 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-04be70b1-ba13-422d-bf27-353634ba2454 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:20.415568 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-04be70b1-ba13-422d-bf27-353634ba2454 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:20.426093 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-04be70b1-ba13-422d-bf27-353634ba2454 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:20.427205 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-04be70b1-ba13-422d-bf27-353634ba2454 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:20.428392 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-04be70b1-ba13-422d-bf27-353634ba2454 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:20.429091 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-04be70b1-ba13-422d-bf27-353634ba2454 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:20.930209 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a6253d5d-49c2-4683-8d19-ea3cdd4c7d1c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:20.945241 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a6253d5d-49c2-4683-8d19-ea3cdd4c7d1c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1362 microversion: 2.1 time: 0.764247 Jan 24 22:28:20.947388 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 29/59] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:20 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1362 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:20.972405 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3d173b67-ee08-4fd8-97d0-e0f6c6136314 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:20.973608 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3d173b67-ee08-4fd8-97d0-e0f6c6136314 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:21.190368 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3d173b67-ee08-4fd8-97d0-e0f6c6136314 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:21.199179 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3d173b67-ee08-4fd8-97d0-e0f6c6136314 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1222 microversion: 2.1 time: 0.248080 Jan 24 22:28:21.201206 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 30/60] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:20 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1222 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:21.215807 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-af7d4faf-68c0-4389-87e8-b776637b884a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:21.219327 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-af7d4faf-68c0-4389-87e8-b776637b884a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:21.237003 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-af7d4faf-68c0-4389-87e8-b776637b884a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:21.237665 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-af7d4faf-68c0-4389-87e8-b776637b884a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:21.239502 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-af7d4faf-68c0-4389-87e8-b776637b884a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:21.241834 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-af7d4faf-68c0-4389-87e8-b776637b884a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:21.364520 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-04be70b1-ba13-422d-bf27-353634ba2454 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:21.379896 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-04be70b1-ba13-422d-bf27-353634ba2454 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1315 microversion: 2.1 time: 0.969349 Jan 24 22:28:21.381985 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 31/61] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:20 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1315 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:21.388416 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-003cc0cd-5561-4a8d-82c8-1dfd6c8fb916 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:21.392508 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-003cc0cd-5561-4a8d-82c8-1dfd6c8fb916 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:21.411186 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-003cc0cd-5561-4a8d-82c8-1dfd6c8fb916 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:21.411963 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-003cc0cd-5561-4a8d-82c8-1dfd6c8fb916 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:21.413450 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-003cc0cd-5561-4a8d-82c8-1dfd6c8fb916 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:21.414028 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-003cc0cd-5561-4a8d-82c8-1dfd6c8fb916 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:21.867098 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-af7d4faf-68c0-4389-87e8-b776637b884a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:21.896203 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-af7d4faf-68c0-4389-87e8-b776637b884a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:21.912752 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-af7d4faf-68c0-4389-87e8-b776637b884a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:21.914872 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-af7d4faf-68c0-4389-87e8-b776637b884a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.710689 Jan 24 22:28:21.915811 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 31/62] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:21 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:21.992325 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-003cc0cd-5561-4a8d-82c8-1dfd6c8fb916 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:22.012699 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-003cc0cd-5561-4a8d-82c8-1dfd6c8fb916 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 0.629230 Jan 24 22:28:22.027976 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 32/63] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:21 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:22.033285 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-9527a5fb-0094-4f09-8a96-1f1854ae2b62 req-e9143783-21d3-41a5-82da-09eb38acf166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a250b35-2478-48ce-b61d-9eae8933d5fb", "tag": "1b9f98aa-61b7-471d-a113-b3ce2247724e"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:22.037032 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:28:22.037032 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:28:22.048828 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-9527a5fb-0094-4f09-8a96-1f1854ae2b62 req-e9143783-21d3-41a5-82da-09eb38acf166 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:22.049481 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-9527a5fb-0094-4f09-8a96-1f1854ae2b62 req-e9143783-21d3-41a5-82da-09eb38acf166 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:22.063935 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-9527a5fb-0094-4f09-8a96-1f1854ae2b62 req-e9143783-21d3-41a5-82da-09eb38acf166 service nova] Creating event network-changed:1b9f98aa-61b7-471d-a113-b3ce2247724e for instance 3a250b35-2478-48ce-b61d-9eae8933d5fb on hv-cinder-81322 Jan 24 22:28:22.071010 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-9527a5fb-0094-4f09-8a96-1f1854ae2b62 req-e9143783-21d3-41a5-82da-09eb38acf166 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041368 Jan 24 22:28:22.072762 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 33/64] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:28:22.080539 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ede91d47-7fa5-476d-bc1e-9c28c02a4fb6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:22.081579 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ede91d47-7fa5-476d-bc1e-9c28c02a4fb6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:22.095449 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ede91d47-7fa5-476d-bc1e-9c28c02a4fb6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:22.096197 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ede91d47-7fa5-476d-bc1e-9c28c02a4fb6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:22.097250 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ede91d47-7fa5-476d-bc1e-9c28c02a4fb6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:22.097827 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ede91d47-7fa5-476d-bc1e-9c28c02a4fb6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:22.250234 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-0a57bbe5-fb4e-44d2-be90-6903e57a04b5 req-2bd28b17-1afd-4a5e-9128-ac0573aedfae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33400f7e-6413-4b0d-8062-8c4befff1b88", "name": "network-vif-plugged", "status": "completed", "tag": "a2470f65-0c4d-4ecd-a4b6-9d25e27a0c99"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:22.251928 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:28:22.251928 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:28:22.271374 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-0a57bbe5-fb4e-44d2-be90-6903e57a04b5 req-2bd28b17-1afd-4a5e-9128-ac0573aedfae service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:22.272035 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-0a57bbe5-fb4e-44d2-be90-6903e57a04b5 req-2bd28b17-1afd-4a5e-9128-ac0573aedfae service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:22.289956 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-0a57bbe5-fb4e-44d2-be90-6903e57a04b5 req-2bd28b17-1afd-4a5e-9128-ac0573aedfae service nova] Creating event network-vif-plugged:a2470f65-0c4d-4ecd-a4b6-9d25e27a0c99 for instance 33400f7e-6413-4b0d-8062-8c4befff1b88 on hv-cinder-81322 Jan 24 22:28:22.301391 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-0a57bbe5-fb4e-44d2-be90-6903e57a04b5 req-2bd28b17-1afd-4a5e-9128-ac0573aedfae service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.383688 Jan 24 22:28:22.304549 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 32/65] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:28:22.315504 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-92d130eb-2c08-477e-a864-8530dcad54ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:22.318545 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-92d130eb-2c08-477e-a864-8530dcad54ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:22.331270 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-92d130eb-2c08-477e-a864-8530dcad54ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:22.334183 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-92d130eb-2c08-477e-a864-8530dcad54ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:22.335265 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-92d130eb-2c08-477e-a864-8530dcad54ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:22.336198 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-92d130eb-2c08-477e-a864-8530dcad54ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:22.642075 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-92d130eb-2c08-477e-a864-8530dcad54ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:22.653277 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-92d130eb-2c08-477e-a864-8530dcad54ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1292 microversion: 2.1 time: 0.347125 Jan 24 22:28:22.659807 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 33/66] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:22 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1292 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:22.664946 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-46c53d38-b6fd-4c35-ac1a-1a6c9c94ac34 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:22.671833 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-46c53d38-b6fd-4c35-ac1a-1a6c9c94ac34 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:22.687665 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-46c53d38-b6fd-4c35-ac1a-1a6c9c94ac34 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:22.689303 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-46c53d38-b6fd-4c35-ac1a-1a6c9c94ac34 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:22.690309 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-46c53d38-b6fd-4c35-ac1a-1a6c9c94ac34 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:22.690942 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-46c53d38-b6fd-4c35-ac1a-1a6c9c94ac34 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:23.105407 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ede91d47-7fa5-476d-bc1e-9c28c02a4fb6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:23.113475 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ede91d47-7fa5-476d-bc1e-9c28c02a4fb6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1362 microversion: 2.1 time: 1.038770 Jan 24 22:28:23.114113 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 34/67] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:22 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1362 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:23.128023 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-03d6faac-340f-4cf7-ae54-d51853fb3efa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:23.133220 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-03d6faac-340f-4cf7-ae54-d51853fb3efa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:23.161311 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-03d6faac-340f-4cf7-ae54-d51853fb3efa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:23.161808 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-03d6faac-340f-4cf7-ae54-d51853fb3efa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:23.162820 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-03d6faac-340f-4cf7-ae54-d51853fb3efa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:23.163444 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-03d6faac-340f-4cf7-ae54-d51853fb3efa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:23.431966 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-46c53d38-b6fd-4c35-ac1a-1a6c9c94ac34 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:23.443869 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-46c53d38-b6fd-4c35-ac1a-1a6c9c94ac34 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1315 microversion: 2.1 time: 0.782290 Jan 24 22:28:23.452755 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 34/68] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:22 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1315 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:23.463077 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-17b5e67e-0492-4fb5-b181-668bdd8d53d1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:23.464273 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-17b5e67e-0492-4fb5-b181-668bdd8d53d1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:23.476706 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-17b5e67e-0492-4fb5-b181-668bdd8d53d1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:23.479344 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-17b5e67e-0492-4fb5-b181-668bdd8d53d1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:23.481291 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-17b5e67e-0492-4fb5-b181-668bdd8d53d1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:23.483003 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-17b5e67e-0492-4fb5-b181-668bdd8d53d1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:23.535109 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-03d6faac-340f-4cf7-ae54-d51853fb3efa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:23.545673 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-03d6faac-340f-4cf7-ae54-d51853fb3efa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:23.547674 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-03d6faac-340f-4cf7-ae54-d51853fb3efa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:23.549428 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-03d6faac-340f-4cf7-ae54-d51853fb3efa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.425558 Jan 24 22:28:23.550370 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 35/69] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:23 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:23.679201 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4a2bb85c-4101-402a-813c-1e98b82fec6d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:23.679891 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4a2bb85c-4101-402a-813c-1e98b82fec6d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:23.692763 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4a2bb85c-4101-402a-813c-1e98b82fec6d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:23.695699 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4a2bb85c-4101-402a-813c-1e98b82fec6d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:23.697478 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4a2bb85c-4101-402a-813c-1e98b82fec6d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:23.699894 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4a2bb85c-4101-402a-813c-1e98b82fec6d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:23.918791 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4a2bb85c-4101-402a-813c-1e98b82fec6d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:23.937863 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4a2bb85c-4101-402a-813c-1e98b82fec6d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1280 microversion: 2.1 time: 0.254775 Jan 24 22:28:23.937863 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 36/70] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:23 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1280 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:24.030159 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-17b5e67e-0492-4fb5-b181-668bdd8d53d1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:24.042384 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-17b5e67e-0492-4fb5-b181-668bdd8d53d1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 0.586891 Jan 24 22:28:24.053301 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 35/71] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:23 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:24.057507 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-c7e65aff-0026-4e27-a305-d12ebfde1c8c req-246e51eb-1249-4b5e-b387-36d1a5f2ef03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a871432f-36c3-495a-8269-9de0a0e45315", "tag": "aabc5fed-da17-478f-810d-56ef4b5caa98"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:24.059386 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:28:24.059386 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:28:24.073801 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-c7e65aff-0026-4e27-a305-d12ebfde1c8c req-246e51eb-1249-4b5e-b387-36d1a5f2ef03 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:24.074245 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-c7e65aff-0026-4e27-a305-d12ebfde1c8c req-246e51eb-1249-4b5e-b387-36d1a5f2ef03 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:24.088890 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-a1a9374e-dede-41df-96d6-dab945680e85 req-16880507-7071-4dd7-b01c-4fd9a25ba177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5995cfc4-026f-45ae-a918-0bc8f1bdc025", "tag": "987c8810-0969-4e25-bb03-7993afce108d"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:24.091272 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:28:24.091272 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:28:24.101950 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-a1a9374e-dede-41df-96d6-dab945680e85 req-16880507-7071-4dd7-b01c-4fd9a25ba177 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:24.102370 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-c7e65aff-0026-4e27-a305-d12ebfde1c8c req-246e51eb-1249-4b5e-b387-36d1a5f2ef03 service nova] Creating event network-changed:aabc5fed-da17-478f-810d-56ef4b5caa98 for instance a871432f-36c3-495a-8269-9de0a0e45315 on hv-cinder-81322 Jan 24 22:28:24.102507 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-a1a9374e-dede-41df-96d6-dab945680e85 req-16880507-7071-4dd7-b01c-4fd9a25ba177 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:24.110600 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-c7e65aff-0026-4e27-a305-d12ebfde1c8c req-246e51eb-1249-4b5e-b387-36d1a5f2ef03 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172110 Jan 24 22:28:24.113204 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 37/72] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:28:24.122301 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-a1a9374e-dede-41df-96d6-dab945680e85 req-16880507-7071-4dd7-b01c-4fd9a25ba177 service nova] Creating event network-changed:987c8810-0969-4e25-bb03-7993afce108d for instance 5995cfc4-026f-45ae-a918-0bc8f1bdc025 on hv-cinder-81322 Jan 24 22:28:24.132361 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-a1a9374e-dede-41df-96d6-dab945680e85 req-16880507-7071-4dd7-b01c-4fd9a25ba177 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047979 Jan 24 22:28:24.132971 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 36/73] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:28:24.137116 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-62f7d63c-9079-4e51-a0e5-df60855035f7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:24.138126 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-62f7d63c-9079-4e51-a0e5-df60855035f7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:24.145361 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-62f7d63c-9079-4e51-a0e5-df60855035f7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:24.146605 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-62f7d63c-9079-4e51-a0e5-df60855035f7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:24.148044 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-62f7d63c-9079-4e51-a0e5-df60855035f7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:24.149148 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-62f7d63c-9079-4e51-a0e5-df60855035f7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:24.329473 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-2c5aad00-cab7-45b4-a9a9-f8c8bca99947 req-8fcbbda6-28f9-41f3-a1a5-60aff4d43858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179be558-5543-42db-b299-8115c58cf1e5", "name": "network-vif-plugged", "status": "completed", "tag": "0843b280-c8c5-4405-93c7-2ba198e91f41"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:24.333745 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:28:24.333745 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:28:24.351123 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-2c5aad00-cab7-45b4-a9a9-f8c8bca99947 req-8fcbbda6-28f9-41f3-a1a5-60aff4d43858 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:24.366789 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-2c5aad00-cab7-45b4-a9a9-f8c8bca99947 req-8fcbbda6-28f9-41f3-a1a5-60aff4d43858 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:24.388041 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-62f7d63c-9079-4e51-a0e5-df60855035f7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:24.394809 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-2c5aad00-cab7-45b4-a9a9-f8c8bca99947 req-8fcbbda6-28f9-41f3-a1a5-60aff4d43858 service nova] Creating event network-vif-plugged:0843b280-c8c5-4405-93c7-2ba198e91f41 for instance 179be558-5543-42db-b299-8115c58cf1e5 on hv-cinder-81322 Jan 24 22:28:24.395930 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-62f7d63c-9079-4e51-a0e5-df60855035f7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1362 microversion: 2.1 time: 0.267166 Jan 24 22:28:24.396510 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 38/74] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:24 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:28:24.425399 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-2c5aad00-cab7-45b4-a9a9-f8c8bca99947 req-8fcbbda6-28f9-41f3-a1a5-60aff4d43858 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095985 Jan 24 22:28:24.426382 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 37/75] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:28:24.469746 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f0415d75-70b8-46e0-b78d-524d06da2a23 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:24.470760 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-f0415d75-70b8-46e0-b78d-524d06da2a23 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:24.482793 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f0415d75-70b8-46e0-b78d-524d06da2a23 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:24.482793 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f0415d75-70b8-46e0-b78d-524d06da2a23 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:24.482793 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f0415d75-70b8-46e0-b78d-524d06da2a23 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:24.482793 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f0415d75-70b8-46e0-b78d-524d06da2a23 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:24.569074 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1d04c05a-1b96-4f82-b9ac-18d3fb56c4f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:24.571238 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-1d04c05a-1b96-4f82-b9ac-18d3fb56c4f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:24.582809 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1d04c05a-1b96-4f82-b9ac-18d3fb56c4f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:24.583960 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1d04c05a-1b96-4f82-b9ac-18d3fb56c4f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:24.584943 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1d04c05a-1b96-4f82-b9ac-18d3fb56c4f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:24.585719 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1d04c05a-1b96-4f82-b9ac-18d3fb56c4f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:24.770133 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-f0415d75-70b8-46e0-b78d-524d06da2a23 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:24.778481 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-f0415d75-70b8-46e0-b78d-524d06da2a23 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1315 microversion: 2.1 time: 0.313462 Jan 24 22:28:24.788071 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 39/76] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:24 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:24.857942 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-1d04c05a-1b96-4f82-b9ac-18d3fb56c4f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:24.866999 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-1d04c05a-1b96-4f82-b9ac-18d3fb56c4f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:24.868771 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-1d04c05a-1b96-4f82-b9ac-18d3fb56c4f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:24.870125 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-1d04c05a-1b96-4f82-b9ac-18d3fb56c4f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.305912 Jan 24 22:28:24.871141 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 38/77] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:24 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:24.951652 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-bd4b00ec-43c0-47ed-9b4e-b4f6d715d3ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:24.952475 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-bd4b00ec-43c0-47ed-9b4e-b4f6d715d3ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:24.958645 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bd4b00ec-43c0-47ed-9b4e-b4f6d715d3ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:24.959357 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bd4b00ec-43c0-47ed-9b4e-b4f6d715d3ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:24.960324 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bd4b00ec-43c0-47ed-9b4e-b4f6d715d3ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:24.960818 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bd4b00ec-43c0-47ed-9b4e-b4f6d715d3ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:25.061974 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3b7deddb-92a8-47c7-a6ab-50a8c5f4ce46 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:25.062587 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3b7deddb-92a8-47c7-a6ab-50a8c5f4ce46 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:25.068929 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3b7deddb-92a8-47c7-a6ab-50a8c5f4ce46 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:25.075231 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3b7deddb-92a8-47c7-a6ab-50a8c5f4ce46 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:25.076167 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3b7deddb-92a8-47c7-a6ab-50a8c5f4ce46 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:25.076597 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3b7deddb-92a8-47c7-a6ab-50a8c5f4ce46 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:25.180038 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-bd4b00ec-43c0-47ed-9b4e-b4f6d715d3ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:25.188957 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-bd4b00ec-43c0-47ed-9b4e-b4f6d715d3ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.240961 Jan 24 22:28:25.189885 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 40/78] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:24 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:25.280144 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3b7deddb-92a8-47c7-a6ab-50a8c5f4ce46 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:25.289991 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3b7deddb-92a8-47c7-a6ab-50a8c5f4ce46 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 0.234448 Jan 24 22:28:25.291067 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 39/79] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:25 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:25.413345 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-46b126d9-8da5-4cf4-bce2-b4c0cf806c87 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:25.414127 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-46b126d9-8da5-4cf4-bce2-b4c0cf806c87 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:25.420360 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-46b126d9-8da5-4cf4-bce2-b4c0cf806c87 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:25.420648 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-46b126d9-8da5-4cf4-bce2-b4c0cf806c87 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:25.421450 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-46b126d9-8da5-4cf4-bce2-b4c0cf806c87 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:25.421872 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-46b126d9-8da5-4cf4-bce2-b4c0cf806c87 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:25.563090 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-46b126d9-8da5-4cf4-bce2-b4c0cf806c87 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:25.571190 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-46b126d9-8da5-4cf4-bce2-b4c0cf806c87 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1362 microversion: 2.1 time: 0.161746 Jan 24 22:28:25.571760 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 41/80] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:25 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:25.795132 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c01dec28-c1c8-41b7-b643-9af7a241fc73 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:25.795778 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c01dec28-c1c8-41b7-b643-9af7a241fc73 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:25.801876 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c01dec28-c1c8-41b7-b643-9af7a241fc73 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:25.802314 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c01dec28-c1c8-41b7-b643-9af7a241fc73 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:25.803278 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c01dec28-c1c8-41b7-b643-9af7a241fc73 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:25.803497 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c01dec28-c1c8-41b7-b643-9af7a241fc73 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:25.888731 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-716e5f96-eedb-4d97-85e7-8fd1b6cff14a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:25.889603 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-716e5f96-eedb-4d97-85e7-8fd1b6cff14a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:25.895931 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-716e5f96-eedb-4d97-85e7-8fd1b6cff14a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:25.896375 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-716e5f96-eedb-4d97-85e7-8fd1b6cff14a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:25.897343 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-716e5f96-eedb-4d97-85e7-8fd1b6cff14a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:25.897765 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-716e5f96-eedb-4d97-85e7-8fd1b6cff14a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:25.955689 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c01dec28-c1c8-41b7-b643-9af7a241fc73 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:25.963412 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c01dec28-c1c8-41b7-b643-9af7a241fc73 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1315 microversion: 2.1 time: 0.171828 Jan 24 22:28:25.964267 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 40/81] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:25 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:26.045367 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-716e5f96-eedb-4d97-85e7-8fd1b6cff14a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:26.053633 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-716e5f96-eedb-4d97-85e7-8fd1b6cff14a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:26.055045 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-716e5f96-eedb-4d97-85e7-8fd1b6cff14a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:26.056139 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-716e5f96-eedb-4d97-85e7-8fd1b6cff14a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.171093 Jan 24 22:28:26.056694 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 42/82] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:25 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:28:26.135507 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-4e24681c-162a-4488-8710-6d33958ee2c3 req-d8106359-cdce-49fc-8d33-cc5bb9913e2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4044f2ed-7e33-45cf-9b1b-6447f372c243", "tag": "80c7633d-9102-4911-954f-6788c2d7bbcc"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:26.137450 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:28:26.137450 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:28:26.144974 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-4e24681c-162a-4488-8710-6d33958ee2c3 req-d8106359-cdce-49fc-8d33-cc5bb9913e2a service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:26.145607 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-4e24681c-162a-4488-8710-6d33958ee2c3 req-d8106359-cdce-49fc-8d33-cc5bb9913e2a service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:26.157160 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-4e24681c-162a-4488-8710-6d33958ee2c3 req-d8106359-cdce-49fc-8d33-cc5bb9913e2a service nova] Creating event network-changed:80c7633d-9102-4911-954f-6788c2d7bbcc for instance 4044f2ed-7e33-45cf-9b1b-6447f372c243 on hv-cinder-81322 Jan 24 22:28:26.162175 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-4e24681c-162a-4488-8710-6d33958ee2c3 req-d8106359-cdce-49fc-8d33-cc5bb9913e2a service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030574 Jan 24 22:28:26.162621 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 41/83] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:28:26.205923 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e63ecf8d-7156-4372-9fb8-262bd22fee68 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:26.207337 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e63ecf8d-7156-4372-9fb8-262bd22fee68 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:26.214723 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e63ecf8d-7156-4372-9fb8-262bd22fee68 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:26.215217 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e63ecf8d-7156-4372-9fb8-262bd22fee68 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:26.216064 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e63ecf8d-7156-4372-9fb8-262bd22fee68 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:26.216537 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e63ecf8d-7156-4372-9fb8-262bd22fee68 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:26.307530 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-5063779d-e6a0-4082-aa2a-4cb03cae69ff tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:26.308143 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-5063779d-e6a0-4082-aa2a-4cb03cae69ff tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:26.319771 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5063779d-e6a0-4082-aa2a-4cb03cae69ff tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:26.320223 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5063779d-e6a0-4082-aa2a-4cb03cae69ff tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:26.321023 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5063779d-e6a0-4082-aa2a-4cb03cae69ff tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:26.321452 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5063779d-e6a0-4082-aa2a-4cb03cae69ff tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:26.398964 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e63ecf8d-7156-4372-9fb8-262bd22fee68 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:26.406479 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e63ecf8d-7156-4372-9fb8-262bd22fee68 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.204579 Jan 24 22:28:26.407038 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 43/84] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:26 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:26.468627 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-5063779d-e6a0-4082-aa2a-4cb03cae69ff tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:26.476602 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-5063779d-e6a0-4082-aa2a-4cb03cae69ff tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 0.173108 Jan 24 22:28:26.477134 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 42/85] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:26 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:26.592006 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f8a68732-47f7-4c31-871a-bca54a0bce0f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:26.592922 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-f8a68732-47f7-4c31-871a-bca54a0bce0f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:26.601858 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f8a68732-47f7-4c31-871a-bca54a0bce0f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:26.602310 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f8a68732-47f7-4c31-871a-bca54a0bce0f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:26.603076 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f8a68732-47f7-4c31-871a-bca54a0bce0f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:26.603505 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f8a68732-47f7-4c31-871a-bca54a0bce0f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:26.752036 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-f8a68732-47f7-4c31-871a-bca54a0bce0f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:26.760310 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-f8a68732-47f7-4c31-871a-bca54a0bce0f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1362 microversion: 2.1 time: 0.174542 Jan 24 22:28:26.760849 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 44/86] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:26 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:26.980350 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ff486b85-3062-4271-b0ce-e1efb4a02db0 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:26.980958 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ff486b85-3062-4271-b0ce-e1efb4a02db0 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:26.987496 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ff486b85-3062-4271-b0ce-e1efb4a02db0 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:26.987960 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ff486b85-3062-4271-b0ce-e1efb4a02db0 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:26.988733 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ff486b85-3062-4271-b0ce-e1efb4a02db0 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:26.989358 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ff486b85-3062-4271-b0ce-e1efb4a02db0 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:27.074226 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0fc35010-ea5e-417c-b3e4-e48be7485755 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:27.074858 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0fc35010-ea5e-417c-b3e4-e48be7485755 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:27.083324 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0fc35010-ea5e-417c-b3e4-e48be7485755 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:27.083773 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0fc35010-ea5e-417c-b3e4-e48be7485755 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:27.084579 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0fc35010-ea5e-417c-b3e4-e48be7485755 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:27.085019 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0fc35010-ea5e-417c-b3e4-e48be7485755 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:27.134559 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ff486b85-3062-4271-b0ce-e1efb4a02db0 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:27.142381 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ff486b85-3062-4271-b0ce-e1efb4a02db0 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1315 microversion: 2.1 time: 0.165850 Jan 24 22:28:27.142948 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 43/87] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:26 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:27.218828 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0fc35010-ea5e-417c-b3e4-e48be7485755 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:27.227550 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0fc35010-ea5e-417c-b3e4-e48be7485755 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:27.229038 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0fc35010-ea5e-417c-b3e4-e48be7485755 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:27.230159 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0fc35010-ea5e-417c-b3e4-e48be7485755 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.159703 Jan 24 22:28:27.230683 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 45/88] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:27 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:27.423259 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a01132e3-0e2a-402d-bab2-2c3944486978 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:27.424319 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a01132e3-0e2a-402d-bab2-2c3944486978 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:27.430944 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a01132e3-0e2a-402d-bab2-2c3944486978 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:27.431409 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a01132e3-0e2a-402d-bab2-2c3944486978 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:27.432198 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a01132e3-0e2a-402d-bab2-2c3944486978 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:27.432625 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a01132e3-0e2a-402d-bab2-2c3944486978 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:27.493157 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e5b2ebb0-4dd6-4da0-b8ae-dc5edc1d3ac1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:27.493830 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e5b2ebb0-4dd6-4da0-b8ae-dc5edc1d3ac1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:27.503438 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e5b2ebb0-4dd6-4da0-b8ae-dc5edc1d3ac1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:27.504376 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e5b2ebb0-4dd6-4da0-b8ae-dc5edc1d3ac1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:27.505329 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e5b2ebb0-4dd6-4da0-b8ae-dc5edc1d3ac1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:27.505761 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e5b2ebb0-4dd6-4da0-b8ae-dc5edc1d3ac1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:27.608742 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a01132e3-0e2a-402d-bab2-2c3944486978 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:27.617972 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a01132e3-0e2a-402d-bab2-2c3944486978 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.198161 Jan 24 22:28:27.618530 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 44/89] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:27 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:27.681129 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e5b2ebb0-4dd6-4da0-b8ae-dc5edc1d3ac1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:27.688521 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e5b2ebb0-4dd6-4da0-b8ae-dc5edc1d3ac1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 0.199370 Jan 24 22:28:27.689131 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 46/90] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:27 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:28:27.777827 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ffd7a5f1-deac-4a3f-b821-d82aa0e1627d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:27.778437 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ffd7a5f1-deac-4a3f-b821-d82aa0e1627d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:27.784453 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ffd7a5f1-deac-4a3f-b821-d82aa0e1627d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:27.784934 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ffd7a5f1-deac-4a3f-b821-d82aa0e1627d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:27.785731 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ffd7a5f1-deac-4a3f-b821-d82aa0e1627d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:27.786230 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ffd7a5f1-deac-4a3f-b821-d82aa0e1627d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:27.921864 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ffd7a5f1-deac-4a3f-b821-d82aa0e1627d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:27.929254 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ffd7a5f1-deac-4a3f-b821-d82aa0e1627d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1362 microversion: 2.1 time: 0.155172 Jan 24 22:28:27.929821 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 45/91] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:27 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:28.162872 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-fd61c21e-5f0b-4160-b8d5-ba73edce6013 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:28.163509 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-fd61c21e-5f0b-4160-b8d5-ba73edce6013 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:28.170101 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fd61c21e-5f0b-4160-b8d5-ba73edce6013 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:28.170548 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fd61c21e-5f0b-4160-b8d5-ba73edce6013 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:28.171318 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fd61c21e-5f0b-4160-b8d5-ba73edce6013 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:28.171747 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fd61c21e-5f0b-4160-b8d5-ba73edce6013 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:28.249013 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b7654146-8787-42e6-ad58-cd189b4be935 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:28.249716 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b7654146-8787-42e6-ad58-cd189b4be935 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:28.256331 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b7654146-8787-42e6-ad58-cd189b4be935 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:28.256955 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b7654146-8787-42e6-ad58-cd189b4be935 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:28.257839 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b7654146-8787-42e6-ad58-cd189b4be935 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:28.258346 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b7654146-8787-42e6-ad58-cd189b4be935 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:28.330115 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-fd61c21e-5f0b-4160-b8d5-ba73edce6013 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:28.337964 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-fd61c21e-5f0b-4160-b8d5-ba73edce6013 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1315 microversion: 2.1 time: 0.180645 Jan 24 22:28:28.338498 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 47/92] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:28 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:28.406610 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b7654146-8787-42e6-ad58-cd189b4be935 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:28.415876 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b7654146-8787-42e6-ad58-cd189b4be935 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:28.417139 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b7654146-8787-42e6-ad58-cd189b4be935 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:28.426402 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b7654146-8787-42e6-ad58-cd189b4be935 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.173265 Jan 24 22:28:28.426402 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 46/93] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:28 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:28.634131 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1094bcfb-2613-4301-b0a4-61d3073df9a5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:28.634728 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1094bcfb-2613-4301-b0a4-61d3073df9a5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:28.640658 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1094bcfb-2613-4301-b0a4-61d3073df9a5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:28.641535 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1094bcfb-2613-4301-b0a4-61d3073df9a5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:28.642308 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1094bcfb-2613-4301-b0a4-61d3073df9a5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:28.642754 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1094bcfb-2613-4301-b0a4-61d3073df9a5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:28.706074 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-780757e5-fca1-4917-bc87-2709867e4ec2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:28.706719 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-780757e5-fca1-4917-bc87-2709867e4ec2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:28.714310 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-780757e5-fca1-4917-bc87-2709867e4ec2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:28.714781 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-780757e5-fca1-4917-bc87-2709867e4ec2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:28.715559 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-780757e5-fca1-4917-bc87-2709867e4ec2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:28.716158 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-780757e5-fca1-4917-bc87-2709867e4ec2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:29.002516 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1094bcfb-2613-4301-b0a4-61d3073df9a5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:29.010571 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1094bcfb-2613-4301-b0a4-61d3073df9a5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.380251 Jan 24 22:28:29.011143 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 48/94] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:28 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:29.015546 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-efc0127d-b4e8-4393-bb45-2548389951ea tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:29.016676 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-efc0127d-b4e8-4393-bb45-2548389951ea tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:29.022722 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-efc0127d-b4e8-4393-bb45-2548389951ea tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:29.023260 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-efc0127d-b4e8-4393-bb45-2548389951ea tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:29.024076 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-efc0127d-b4e8-4393-bb45-2548389951ea tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:29.024505 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-efc0127d-b4e8-4393-bb45-2548389951ea tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:29.030834 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-780757e5-fca1-4917-bc87-2709867e4ec2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:29.038456 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-780757e5-fca1-4917-bc87-2709867e4ec2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 0.336340 Jan 24 22:28:29.039108 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 47/95] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:28 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:29.161545 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-efc0127d-b4e8-4393-bb45-2548389951ea tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:29.168822 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-efc0127d-b4e8-4393-bb45-2548389951ea tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1362 microversion: 2.1 time: 0.156532 Jan 24 22:28:29.169452 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 49/96] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:29 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:29.359845 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7b1c5d6d-1d21-44b8-9df4-0f12deeb20ca tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:29.361521 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7b1c5d6d-1d21-44b8-9df4-0f12deeb20ca tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:29.369362 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7b1c5d6d-1d21-44b8-9df4-0f12deeb20ca tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:29.369803 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7b1c5d6d-1d21-44b8-9df4-0f12deeb20ca tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:29.370564 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7b1c5d6d-1d21-44b8-9df4-0f12deeb20ca tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:29.370991 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7b1c5d6d-1d21-44b8-9df4-0f12deeb20ca tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:29.436702 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6fc8730a-9d13-4416-b867-2880d9728cbc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:29.437343 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6fc8730a-9d13-4416-b867-2880d9728cbc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:29.443673 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6fc8730a-9d13-4416-b867-2880d9728cbc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:29.445189 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6fc8730a-9d13-4416-b867-2880d9728cbc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:29.446137 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6fc8730a-9d13-4416-b867-2880d9728cbc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:29.446717 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6fc8730a-9d13-4416-b867-2880d9728cbc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:29.553987 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7b1c5d6d-1d21-44b8-9df4-0f12deeb20ca tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:29.561505 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7b1c5d6d-1d21-44b8-9df4-0f12deeb20ca tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1315 microversion: 2.1 time: 0.207618 Jan 24 22:28:29.562109 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 48/97] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:29 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:29.614404 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6fc8730a-9d13-4416-b867-2880d9728cbc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:29.622653 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6fc8730a-9d13-4416-b867-2880d9728cbc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:29.624310 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6fc8730a-9d13-4416-b867-2880d9728cbc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:29.625458 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6fc8730a-9d13-4416-b867-2880d9728cbc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.192562 Jan 24 22:28:29.626073 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 50/98] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:29 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:30.027955 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-61729aef-bb6e-403b-ba58-0fdc25af49d8 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:30.028566 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-61729aef-bb6e-403b-ba58-0fdc25af49d8 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:30.035016 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-61729aef-bb6e-403b-ba58-0fdc25af49d8 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:30.035462 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-61729aef-bb6e-403b-ba58-0fdc25af49d8 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:30.036273 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-61729aef-bb6e-403b-ba58-0fdc25af49d8 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:30.036730 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-61729aef-bb6e-403b-ba58-0fdc25af49d8 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:30.055253 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b9a05795-c1ca-44d1-994d-726bc0c50883 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:30.055863 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b9a05795-c1ca-44d1-994d-726bc0c50883 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:30.062192 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b9a05795-c1ca-44d1-994d-726bc0c50883 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:30.062633 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b9a05795-c1ca-44d1-994d-726bc0c50883 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:30.063430 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b9a05795-c1ca-44d1-994d-726bc0c50883 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:30.063857 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b9a05795-c1ca-44d1-994d-726bc0c50883 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:30.233640 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-61729aef-bb6e-403b-ba58-0fdc25af49d8 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:30.237074 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b9a05795-c1ca-44d1-994d-726bc0c50883 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:30.241277 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-61729aef-bb6e-403b-ba58-0fdc25af49d8 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.216705 Jan 24 22:28:30.241974 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 49/99] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:30 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:30.246316 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-0eea71f5-eecb-4801-aaed-85c02bee2db0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:30.246990 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-0eea71f5-eecb-4801-aaed-85c02bee2db0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:30.247810 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b9a05795-c1ca-44d1-994d-726bc0c50883 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 0.196416 Jan 24 22:28:30.249026 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 51/100] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:30 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:30.253692 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0eea71f5-eecb-4801-aaed-85c02bee2db0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:30.254141 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0eea71f5-eecb-4801-aaed-85c02bee2db0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:30.254914 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0eea71f5-eecb-4801-aaed-85c02bee2db0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:30.255338 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0eea71f5-eecb-4801-aaed-85c02bee2db0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:30.406447 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-0eea71f5-eecb-4801-aaed-85c02bee2db0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:30.414410 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-0eea71f5-eecb-4801-aaed-85c02bee2db0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1362 microversion: 2.1 time: 0.171425 Jan 24 22:28:30.414993 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 50/101] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:30 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:30.579093 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0c3aef62-60bd-4f6c-a1b6-442c853af97d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:30.579773 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0c3aef62-60bd-4f6c-a1b6-442c853af97d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:30.586682 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0c3aef62-60bd-4f6c-a1b6-442c853af97d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:30.587193 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0c3aef62-60bd-4f6c-a1b6-442c853af97d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:30.588034 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0c3aef62-60bd-4f6c-a1b6-442c853af97d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:30.588524 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0c3aef62-60bd-4f6c-a1b6-442c853af97d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:30.645325 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-dcaedd6b-132e-41c5-af81-0b0e7cbb9b66 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:30.646278 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-dcaedd6b-132e-41c5-af81-0b0e7cbb9b66 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:30.653752 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-dcaedd6b-132e-41c5-af81-0b0e7cbb9b66 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:30.655117 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-dcaedd6b-132e-41c5-af81-0b0e7cbb9b66 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:30.655940 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-dcaedd6b-132e-41c5-af81-0b0e7cbb9b66 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:30.656426 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-dcaedd6b-132e-41c5-af81-0b0e7cbb9b66 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:30.806941 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0c3aef62-60bd-4f6c-a1b6-442c853af97d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:30.817481 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0c3aef62-60bd-4f6c-a1b6-442c853af97d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1315 microversion: 2.1 time: 0.241817 Jan 24 22:28:30.818466 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 52/102] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:30 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:30.871784 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-dcaedd6b-132e-41c5-af81-0b0e7cbb9b66 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:30.882856 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-dcaedd6b-132e-41c5-af81-0b0e7cbb9b66 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:30.883477 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-dcaedd6b-132e-41c5-af81-0b0e7cbb9b66 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:30.884608 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-dcaedd6b-132e-41c5-af81-0b0e7cbb9b66 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.243941 Jan 24 22:28:30.896239 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 51/103] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:30 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:31.260665 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-60d5f0a4-6459-4039-b38e-cd47990e4fa4 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:31.261428 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-60d5f0a4-6459-4039-b38e-cd47990e4fa4 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:31.265854 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-fa6a13ea-8701-453a-8c3f-946ef7ef9102 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:31.266959 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-fa6a13ea-8701-453a-8c3f-946ef7ef9102 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:31.269790 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-60d5f0a4-6459-4039-b38e-cd47990e4fa4 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:31.270454 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-60d5f0a4-6459-4039-b38e-cd47990e4fa4 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:31.271319 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-60d5f0a4-6459-4039-b38e-cd47990e4fa4 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:31.271925 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-60d5f0a4-6459-4039-b38e-cd47990e4fa4 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:31.275098 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fa6a13ea-8701-453a-8c3f-946ef7ef9102 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:31.275648 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fa6a13ea-8701-453a-8c3f-946ef7ef9102 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:31.276592 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fa6a13ea-8701-453a-8c3f-946ef7ef9102 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:31.277141 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fa6a13ea-8701-453a-8c3f-946ef7ef9102 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:31.487838 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-60d5f0a4-6459-4039-b38e-cd47990e4fa4 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:31.492375 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-fa6a13ea-8701-453a-8c3f-946ef7ef9102 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:31.496004 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-60d5f0a4-6459-4039-b38e-cd47990e4fa4 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.240201 Jan 24 22:28:31.496552 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 53/104] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:31 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:31.500898 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4b88a11f-d798-4454-899f-2cf8bc5ec3dc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:31.501547 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4b88a11f-d798-4454-899f-2cf8bc5ec3dc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:31.507852 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4b88a11f-d798-4454-899f-2cf8bc5ec3dc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:31.508296 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4b88a11f-d798-4454-899f-2cf8bc5ec3dc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:31.508421 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-fa6a13ea-8701-453a-8c3f-946ef7ef9102 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 0.246862 Jan 24 22:28:31.509233 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 52/105] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:31 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:31.509366 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4b88a11f-d798-4454-899f-2cf8bc5ec3dc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:31.509766 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4b88a11f-d798-4454-899f-2cf8bc5ec3dc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:31.657961 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4b88a11f-d798-4454-899f-2cf8bc5ec3dc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:31.672009 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4b88a11f-d798-4454-899f-2cf8bc5ec3dc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1362 microversion: 2.1 time: 0.174358 Jan 24 22:28:31.672794 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 54/106] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:31 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:31.838824 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-be59c4c3-5336-4c6f-af2b-083769152c06 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:31.839675 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-be59c4c3-5336-4c6f-af2b-083769152c06 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:31.849960 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-be59c4c3-5336-4c6f-af2b-083769152c06 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:31.850813 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-be59c4c3-5336-4c6f-af2b-083769152c06 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:31.851740 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-be59c4c3-5336-4c6f-af2b-083769152c06 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:31.852172 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-be59c4c3-5336-4c6f-af2b-083769152c06 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:31.903189 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2d154bd7-e7b4-43ea-aff8-b6bd1ae7508c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:31.903913 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2d154bd7-e7b4-43ea-aff8-b6bd1ae7508c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:31.910313 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2d154bd7-e7b4-43ea-aff8-b6bd1ae7508c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:31.911667 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2d154bd7-e7b4-43ea-aff8-b6bd1ae7508c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:31.911812 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2d154bd7-e7b4-43ea-aff8-b6bd1ae7508c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:31.912271 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2d154bd7-e7b4-43ea-aff8-b6bd1ae7508c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:32.014208 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-be59c4c3-5336-4c6f-af2b-083769152c06 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:32.024297 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-be59c4c3-5336-4c6f-af2b-083769152c06 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1315 microversion: 2.1 time: 0.192038 Jan 24 22:28:32.024886 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 53/107] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:31 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:32.085184 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2d154bd7-e7b4-43ea-aff8-b6bd1ae7508c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:32.093307 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2d154bd7-e7b4-43ea-aff8-b6bd1ae7508c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:32.094701 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2d154bd7-e7b4-43ea-aff8-b6bd1ae7508c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:32.095807 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2d154bd7-e7b4-43ea-aff8-b6bd1ae7508c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.196381 Jan 24 22:28:32.096365 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 55/108] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:31 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:32.517212 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e6a9389c-674f-4422-bfc2-3595ca497d6b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:32.518193 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e6a9389c-674f-4422-bfc2-3595ca497d6b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:32.528433 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e6a9389c-674f-4422-bfc2-3595ca497d6b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:32.529240 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e6a9389c-674f-4422-bfc2-3595ca497d6b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:32.530121 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-8a56b831-6bd6-47fb-9a22-0e6e0786243e tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:32.530464 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e6a9389c-674f-4422-bfc2-3595ca497d6b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:32.531119 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-8a56b831-6bd6-47fb-9a22-0e6e0786243e tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:32.531345 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e6a9389c-674f-4422-bfc2-3595ca497d6b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:32.540456 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8a56b831-6bd6-47fb-9a22-0e6e0786243e tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:32.540914 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8a56b831-6bd6-47fb-9a22-0e6e0786243e tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:32.541730 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8a56b831-6bd6-47fb-9a22-0e6e0786243e tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:32.542191 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8a56b831-6bd6-47fb-9a22-0e6e0786243e tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:32.736771 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e6a9389c-674f-4422-bfc2-3595ca497d6b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:32.739977 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-8a56b831-6bd6-47fb-9a22-0e6e0786243e tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:32.746105 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e6a9389c-674f-4422-bfc2-3595ca497d6b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.235323 Jan 24 22:28:32.746983 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 54/109] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:32 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:32.748192 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-8a56b831-6bd6-47fb-9a22-0e6e0786243e tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 0.224340 Jan 24 22:28:32.757463 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 56/110] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:32 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:32.757634 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-16a776ff-bf90-494e-95a7-3dfa2a7a7bc2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:32.757634 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-16a776ff-bf90-494e-95a7-3dfa2a7a7bc2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:32.757930 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-16a776ff-bf90-494e-95a7-3dfa2a7a7bc2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:32.758499 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-16a776ff-bf90-494e-95a7-3dfa2a7a7bc2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:32.759322 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-16a776ff-bf90-494e-95a7-3dfa2a7a7bc2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:32.759746 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-16a776ff-bf90-494e-95a7-3dfa2a7a7bc2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:32.902456 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-16a776ff-bf90-494e-95a7-3dfa2a7a7bc2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:32.910234 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-16a776ff-bf90-494e-95a7-3dfa2a7a7bc2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1362 microversion: 2.1 time: 0.162432 Jan 24 22:28:32.910797 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 55/111] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:32 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:33.041151 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-d9032008-17c3-4c48-82b8-8cffc9cfe087 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:33.041745 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-d9032008-17c3-4c48-82b8-8cffc9cfe087 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:33.047529 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d9032008-17c3-4c48-82b8-8cffc9cfe087 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:33.047967 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d9032008-17c3-4c48-82b8-8cffc9cfe087 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:33.048725 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d9032008-17c3-4c48-82b8-8cffc9cfe087 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:33.049180 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d9032008-17c3-4c48-82b8-8cffc9cfe087 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:33.113865 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ccba7409-2c44-4d9c-9f3d-04b26e809366 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:33.114477 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ccba7409-2c44-4d9c-9f3d-04b26e809366 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:33.120333 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ccba7409-2c44-4d9c-9f3d-04b26e809366 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:33.120778 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ccba7409-2c44-4d9c-9f3d-04b26e809366 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:33.121582 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ccba7409-2c44-4d9c-9f3d-04b26e809366 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:33.122011 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ccba7409-2c44-4d9c-9f3d-04b26e809366 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:33.201991 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-d9032008-17c3-4c48-82b8-8cffc9cfe087 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:33.209294 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-d9032008-17c3-4c48-82b8-8cffc9cfe087 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1315 microversion: 2.1 time: 0.171841 Jan 24 22:28:33.210064 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 57/112] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:33 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:33.273836 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ccba7409-2c44-4d9c-9f3d-04b26e809366 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:33.281985 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ccba7409-2c44-4d9c-9f3d-04b26e809366 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:33.283466 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ccba7409-2c44-4d9c-9f3d-04b26e809366 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:33.284596 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ccba7409-2c44-4d9c-9f3d-04b26e809366 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.174482 Jan 24 22:28:33.285196 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 56/113] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:33 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:33.763705 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1dab7374-846a-4ec9-b3ab-8aea10ac03d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:33.764917 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1dab7374-846a-4ec9-b3ab-8aea10ac03d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:33.765349 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6f54cbab-d267-43ee-8e67-2b830fc31eb9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:33.766953 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6f54cbab-d267-43ee-8e67-2b830fc31eb9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:33.771715 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1dab7374-846a-4ec9-b3ab-8aea10ac03d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:33.772522 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1dab7374-846a-4ec9-b3ab-8aea10ac03d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:33.773587 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1dab7374-846a-4ec9-b3ab-8aea10ac03d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:33.773825 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6f54cbab-d267-43ee-8e67-2b830fc31eb9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:33.774320 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1dab7374-846a-4ec9-b3ab-8aea10ac03d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:33.774455 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6f54cbab-d267-43ee-8e67-2b830fc31eb9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:33.775679 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6f54cbab-d267-43ee-8e67-2b830fc31eb9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:33.776230 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6f54cbab-d267-43ee-8e67-2b830fc31eb9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:34.055231 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1dab7374-846a-4ec9-b3ab-8aea10ac03d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:34.064555 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1dab7374-846a-4ec9-b3ab-8aea10ac03d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.304826 Jan 24 22:28:34.066211 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-6f54cbab-d267-43ee-8e67-2b830fc31eb9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:34.075436 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 58/114] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:33 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:34.076006 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6f54cbab-d267-43ee-8e67-2b830fc31eb9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 0.314493 Jan 24 22:28:34.085766 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 57/115] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:33 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:34.089998 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-15bf2539-dd15-42e4-a390-5bc4cb140b97 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:34.090765 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-15bf2539-dd15-42e4-a390-5bc4cb140b97 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:34.098383 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-15bf2539-dd15-42e4-a390-5bc4cb140b97 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:34.098829 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-15bf2539-dd15-42e4-a390-5bc4cb140b97 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:34.099608 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-15bf2539-dd15-42e4-a390-5bc4cb140b97 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:34.100937 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-15bf2539-dd15-42e4-a390-5bc4cb140b97 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:34.227086 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3cd1d018-8d16-4913-878d-71fd48dce04b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:34.227976 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3cd1d018-8d16-4913-878d-71fd48dce04b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:34.234809 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3cd1d018-8d16-4913-878d-71fd48dce04b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:34.235451 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3cd1d018-8d16-4913-878d-71fd48dce04b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:34.237058 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3cd1d018-8d16-4913-878d-71fd48dce04b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:34.237646 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3cd1d018-8d16-4913-878d-71fd48dce04b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:34.412042 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-15bf2539-dd15-42e4-a390-5bc4cb140b97 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:34.421105 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-15bf2539-dd15-42e4-a390-5bc4cb140b97 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1362 microversion: 2.1 time: 0.344503 Jan 24 22:28:34.421688 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 59/116] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:34 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:34.426589 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3c27f164-917f-42b6-bc17-fe084827e2b9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:34.427186 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-3c27f164-917f-42b6-bc17-fe084827e2b9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:34.433795 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3c27f164-917f-42b6-bc17-fe084827e2b9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:34.434424 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3c27f164-917f-42b6-bc17-fe084827e2b9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:34.435204 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3c27f164-917f-42b6-bc17-fe084827e2b9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:34.435631 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3c27f164-917f-42b6-bc17-fe084827e2b9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:34.512218 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3cd1d018-8d16-4913-878d-71fd48dce04b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:34.521921 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3cd1d018-8d16-4913-878d-71fd48dce04b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1500 microversion: 2.1 time: 0.299160 Jan 24 22:28:34.523159 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 58/117] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:34 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1500 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:28:34.590499 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3c27f164-917f-42b6-bc17-fe084827e2b9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:34.598363 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3c27f164-917f-42b6-bc17-fe084827e2b9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:34.599912 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3c27f164-917f-42b6-bc17-fe084827e2b9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:34.601008 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-3c27f164-917f-42b6-bc17-fe084827e2b9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.178183 Jan 24 22:28:34.601576 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 60/118] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:34 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:35.085828 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a514ffdc-f213-45bb-96f6-e6c63dbe3f2a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:35.086363 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a514ffdc-f213-45bb-96f6-e6c63dbe3f2a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:35.092372 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-5db880ce-dc22-4a1e-83f6-1976db27d9ff tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:35.092832 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a514ffdc-f213-45bb-96f6-e6c63dbe3f2a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:35.093103 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-5db880ce-dc22-4a1e-83f6-1976db27d9ff tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:35.093235 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a514ffdc-f213-45bb-96f6-e6c63dbe3f2a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:35.093890 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a514ffdc-f213-45bb-96f6-e6c63dbe3f2a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:35.094315 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a514ffdc-f213-45bb-96f6-e6c63dbe3f2a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:35.099293 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5db880ce-dc22-4a1e-83f6-1976db27d9ff tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:35.099747 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5db880ce-dc22-4a1e-83f6-1976db27d9ff tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:35.100514 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5db880ce-dc22-4a1e-83f6-1976db27d9ff tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:35.100926 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5db880ce-dc22-4a1e-83f6-1976db27d9ff tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:35.279773 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a514ffdc-f213-45bb-96f6-e6c63dbe3f2a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:35.286935 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5db880ce-dc22-4a1e-83f6-1976db27d9ff tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:35.287455 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a514ffdc-f213-45bb-96f6-e6c63dbe3f2a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.207921 Jan 24 22:28:35.288027 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 59/119] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:35 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:35.295140 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-5db880ce-dc22-4a1e-83f6-1976db27d9ff tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 0.206319 Jan 24 22:28:35.297714 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 61/120] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:35 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:35.441046 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c5272141-b613-4194-98db-9a96164836a0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:35.442052 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c5272141-b613-4194-98db-9a96164836a0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:35.450817 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c5272141-b613-4194-98db-9a96164836a0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:35.451189 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c5272141-b613-4194-98db-9a96164836a0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:35.452004 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c5272141-b613-4194-98db-9a96164836a0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:35.452438 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c5272141-b613-4194-98db-9a96164836a0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:35.594978 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c5272141-b613-4194-98db-9a96164836a0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:35.603272 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c5272141-b613-4194-98db-9a96164836a0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1362 microversion: 2.1 time: 0.167474 Jan 24 22:28:35.603817 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 60/121] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:35 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:35.618875 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e32123a9-cd10-4617-bf58-a8ad2431e646 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:35.619475 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e32123a9-cd10-4617-bf58-a8ad2431e646 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:35.625858 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e32123a9-cd10-4617-bf58-a8ad2431e646 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:35.626297 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e32123a9-cd10-4617-bf58-a8ad2431e646 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:35.627077 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e32123a9-cd10-4617-bf58-a8ad2431e646 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:35.627471 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e32123a9-cd10-4617-bf58-a8ad2431e646 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:35.770842 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e32123a9-cd10-4617-bf58-a8ad2431e646 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:35.778944 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e32123a9-cd10-4617-bf58-a8ad2431e646 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:35.780491 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e32123a9-cd10-4617-bf58-a8ad2431e646 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:35.781726 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e32123a9-cd10-4617-bf58-a8ad2431e646 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.166613 Jan 24 22:28:35.782282 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 62/122] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:35 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:36.311703 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7849f6c4-bbdd-4857-b8c8-ff4b71299364 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:36.312579 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7849f6c4-bbdd-4857-b8c8-ff4b71299364 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:36.313332 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-d236406a-46fa-4925-a757-025398c7be45 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:36.313937 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-d236406a-46fa-4925-a757-025398c7be45 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:36.318781 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7849f6c4-bbdd-4857-b8c8-ff4b71299364 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:36.319226 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7849f6c4-bbdd-4857-b8c8-ff4b71299364 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:36.320103 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d236406a-46fa-4925-a757-025398c7be45 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:36.320571 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d236406a-46fa-4925-a757-025398c7be45 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:36.320764 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7849f6c4-bbdd-4857-b8c8-ff4b71299364 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:36.321195 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7849f6c4-bbdd-4857-b8c8-ff4b71299364 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:36.321355 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d236406a-46fa-4925-a757-025398c7be45 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:36.321770 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d236406a-46fa-4925-a757-025398c7be45 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:36.519011 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7849f6c4-bbdd-4857-b8c8-ff4b71299364 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:36.522467 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-d236406a-46fa-4925-a757-025398c7be45 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:36.526915 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7849f6c4-bbdd-4857-b8c8-ff4b71299364 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.226773 Jan 24 22:28:36.527490 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 61/123] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:36 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:36.529664 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-d236406a-46fa-4925-a757-025398c7be45 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1317 microversion: 2.1 time: 0.219995 Jan 24 22:28:36.530221 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 63/124] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:36 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:28:36.624032 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8d83acbf-5d3e-47f8-89ba-af70df66510e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:36.624953 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8d83acbf-5d3e-47f8-89ba-af70df66510e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:36.635179 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8d83acbf-5d3e-47f8-89ba-af70df66510e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:36.635924 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8d83acbf-5d3e-47f8-89ba-af70df66510e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:36.637257 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8d83acbf-5d3e-47f8-89ba-af70df66510e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:36.637982 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8d83acbf-5d3e-47f8-89ba-af70df66510e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:36.783444 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-8d83acbf-5d3e-47f8-89ba-af70df66510e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:36.792964 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8d83acbf-5d3e-47f8-89ba-af70df66510e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1362 microversion: 2.1 time: 0.175065 Jan 24 22:28:36.799460 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-5385fd37-8858-48a9-982d-1b7cef1486a9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:36.800163 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-5385fd37-8858-48a9-982d-1b7cef1486a9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:36.801901 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 62/125] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:36 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:36.806654 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5385fd37-8858-48a9-982d-1b7cef1486a9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:36.807221 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5385fd37-8858-48a9-982d-1b7cef1486a9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:36.808021 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5385fd37-8858-48a9-982d-1b7cef1486a9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:36.808439 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5385fd37-8858-48a9-982d-1b7cef1486a9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:36.950487 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5385fd37-8858-48a9-982d-1b7cef1486a9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:36.961324 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5385fd37-8858-48a9-982d-1b7cef1486a9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:36.963170 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5385fd37-8858-48a9-982d-1b7cef1486a9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:36.964262 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-5385fd37-8858-48a9-982d-1b7cef1486a9 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.168545 Jan 24 22:28:36.964792 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 64/126] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:36 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:37.545945 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-86fb7da8-4262-410c-9305-82a91ab07fe8 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:37.546558 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-86fb7da8-4262-410c-9305-82a91ab07fe8 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:37.547659 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-88faedad-0d2b-4d34-912e-d8e199895c71 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:37.548345 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-88faedad-0d2b-4d34-912e-d8e199895c71 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:37.555118 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-86fb7da8-4262-410c-9305-82a91ab07fe8 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:37.555599 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-86fb7da8-4262-410c-9305-82a91ab07fe8 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:37.556392 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-86fb7da8-4262-410c-9305-82a91ab07fe8 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:37.556527 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-88faedad-0d2b-4d34-912e-d8e199895c71 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:37.556822 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-86fb7da8-4262-410c-9305-82a91ab07fe8 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:37.556998 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-88faedad-0d2b-4d34-912e-d8e199895c71 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:37.557710 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-88faedad-0d2b-4d34-912e-d8e199895c71 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:37.558138 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-88faedad-0d2b-4d34-912e-d8e199895c71 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:37.745120 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-86fb7da8-4262-410c-9305-82a91ab07fe8 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:37.749153 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-88faedad-0d2b-4d34-912e-d8e199895c71 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:37.753160 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-86fb7da8-4262-410c-9305-82a91ab07fe8 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.212581 Jan 24 22:28:37.753846 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 63/127] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:37 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:37.758703 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-88faedad-0d2b-4d34-912e-d8e199895c71 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1506 microversion: 2.1 time: 0.216008 Jan 24 22:28:37.759376 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 65/128] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:37 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:37.812916 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-29af7e18-f6cf-4b38-95e5-cf9b89a8349b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:37.813560 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-29af7e18-f6cf-4b38-95e5-cf9b89a8349b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:37.821035 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-29af7e18-f6cf-4b38-95e5-cf9b89a8349b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:37.821630 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-29af7e18-f6cf-4b38-95e5-cf9b89a8349b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:37.822498 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-29af7e18-f6cf-4b38-95e5-cf9b89a8349b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:37.823093 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-29af7e18-f6cf-4b38-95e5-cf9b89a8349b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:37.970101 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-29af7e18-f6cf-4b38-95e5-cf9b89a8349b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:37.979053 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-29af7e18-f6cf-4b38-95e5-cf9b89a8349b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1362 microversion: 2.1 time: 0.170083 Jan 24 22:28:37.979700 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 64/129] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:37 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:37.981807 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-df98a3dc-3b1a-4273-ba5c-4394e17e42c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:37.982401 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-df98a3dc-3b1a-4273-ba5c-4394e17e42c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:37.993784 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-df98a3dc-3b1a-4273-ba5c-4394e17e42c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:37.994470 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-df98a3dc-3b1a-4273-ba5c-4394e17e42c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:37.995435 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-df98a3dc-3b1a-4273-ba5c-4394e17e42c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:37.995863 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-df98a3dc-3b1a-4273-ba5c-4394e17e42c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:38.176797 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-df98a3dc-3b1a-4273-ba5c-4394e17e42c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:38.185079 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-df98a3dc-3b1a-4273-ba5c-4394e17e42c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:38.186491 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-df98a3dc-3b1a-4273-ba5c-4394e17e42c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:38.187591 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-df98a3dc-3b1a-4273-ba5c-4394e17e42c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.209437 Jan 24 22:28:38.188144 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 66/130] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:37 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:28:38.244729 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-27a9c405-1133-48f6-91a0-a1c9e00ae364 req-e53bb2ef-b025-4ac2-9431-3b9ec8c908b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a250b35-2478-48ce-b61d-9eae8933d5fb", "name": "network-vif-plugged", "status": "completed", "tag": "1b9f98aa-61b7-471d-a113-b3ce2247724e"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:38.246366 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:28:38.246366 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:28:38.253158 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-27a9c405-1133-48f6-91a0-a1c9e00ae364 req-e53bb2ef-b025-4ac2-9431-3b9ec8c908b1 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:38.253590 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-27a9c405-1133-48f6-91a0-a1c9e00ae364 req-e53bb2ef-b025-4ac2-9431-3b9ec8c908b1 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:38.264516 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-27a9c405-1133-48f6-91a0-a1c9e00ae364 req-e53bb2ef-b025-4ac2-9431-3b9ec8c908b1 service nova] Creating event network-vif-plugged:1b9f98aa-61b7-471d-a113-b3ce2247724e for instance 3a250b35-2478-48ce-b61d-9eae8933d5fb on hv-cinder-81322 Jan 24 22:28:38.270065 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-27a9c405-1133-48f6-91a0-a1c9e00ae364 req-e53bb2ef-b025-4ac2-9431-3b9ec8c908b1 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029167 Jan 24 22:28:38.270624 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 65/131] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:28:38.772282 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0abcfcac-74e8-4c38-99c6-516f77b95f1e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:38.772769 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0abcfcac-74e8-4c38-99c6-516f77b95f1e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:38.780290 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0abcfcac-74e8-4c38-99c6-516f77b95f1e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:38.780737 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0abcfcac-74e8-4c38-99c6-516f77b95f1e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:38.781544 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0abcfcac-74e8-4c38-99c6-516f77b95f1e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:38.781970 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0abcfcac-74e8-4c38-99c6-516f77b95f1e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:38.925788 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0abcfcac-74e8-4c38-99c6-516f77b95f1e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:38.933591 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0abcfcac-74e8-4c38-99c6-516f77b95f1e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.165321 Jan 24 22:28:38.934155 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 67/132] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:38 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:38.998306 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7c5695a8-ae55-4161-b664-e4d88db1a963 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:38.999142 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7c5695a8-ae55-4161-b664-e4d88db1a963 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:39.005594 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7c5695a8-ae55-4161-b664-e4d88db1a963 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:39.006036 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7c5695a8-ae55-4161-b664-e4d88db1a963 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:39.006812 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7c5695a8-ae55-4161-b664-e4d88db1a963 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:39.007221 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7c5695a8-ae55-4161-b664-e4d88db1a963 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:39.031309 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-fe974af5-b499-4532-acd5-640ba3e968d6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "983cb989-7af5-4d59-b1f8-5853ca05708b"}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:39.033158 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-fe974af5-b499-4532-acd5-640ba3e968d6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:39.039203 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fe974af5-b499-4532-acd5-640ba3e968d6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:39.039879 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fe974af5-b499-4532-acd5-640ba3e968d6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:39.040842 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fe974af5-b499-4532-acd5-640ba3e968d6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:39.041679 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fe974af5-b499-4532-acd5-640ba3e968d6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:39.174652 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7c5695a8-ae55-4161-b664-e4d88db1a963 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:39.182532 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7c5695a8-ae55-4161-b664-e4d88db1a963 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1362 microversion: 2.1 time: 0.188237 Jan 24 22:28:39.183239 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 66/133] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:38 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:39.187991 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a6a0b7fe-b94f-42a3-afb2-0a4267881c43 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21eda49d-3c31-45e7-ba92-b7c0a2bba992"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:39.189043 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a6a0b7fe-b94f-42a3-afb2-0a4267881c43 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:39.195336 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a6a0b7fe-b94f-42a3-afb2-0a4267881c43 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:39.195780 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a6a0b7fe-b94f-42a3-afb2-0a4267881c43 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:39.196557 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a6a0b7fe-b94f-42a3-afb2-0a4267881c43 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:39.196979 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a6a0b7fe-b94f-42a3-afb2-0a4267881c43 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:42.175604 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-fe974af5-b499-4532-acd5-640ba3e968d6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "POST /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.147832 Jan 24 22:28:42.179706 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a6a0b7fe-b94f-42a3-afb2-0a4267881c43 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "POST /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.994985 Jan 24 22:28:42.181053 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 67/134] 10.222.0.84 () {60 vars in 1322 bytes} [Mon Jan 24 22:28:39 2022] POST /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5/os-volume_attachments => generated 194 bytes in 2996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:28:42.181186 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 68/135] 10.222.0.84 () {60 vars in 1322 bytes} [Mon Jan 24 22:28:39 2022] POST /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88/os-volume_attachments => generated 194 bytes in 3154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:28:42.186168 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e04b3e0d-fce3-4cea-bb06-9ec0c9fb25d6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:42.186863 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e04b3e0d-fce3-4cea-bb06-9ec0c9fb25d6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:42.193260 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e04b3e0d-fce3-4cea-bb06-9ec0c9fb25d6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:42.193692 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e04b3e0d-fce3-4cea-bb06-9ec0c9fb25d6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:42.194472 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e04b3e0d-fce3-4cea-bb06-9ec0c9fb25d6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:42.194975 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e04b3e0d-fce3-4cea-bb06-9ec0c9fb25d6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:42.207201 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e175fef2-52fc-41f7-b18e-d80ab28f260c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:42.207893 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e175fef2-52fc-41f7-b18e-d80ab28f260c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:42.217321 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e175fef2-52fc-41f7-b18e-d80ab28f260c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:42.217698 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e175fef2-52fc-41f7-b18e-d80ab28f260c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:42.218885 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e175fef2-52fc-41f7-b18e-d80ab28f260c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:42.219474 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e175fef2-52fc-41f7-b18e-d80ab28f260c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:42.411663 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e04b3e0d-fce3-4cea-bb06-9ec0c9fb25d6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:42.419477 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e04b3e0d-fce3-4cea-bb06-9ec0c9fb25d6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.237085 Jan 24 22:28:42.420086 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 69/136] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:42 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:42.423799 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e175fef2-52fc-41f7-b18e-d80ab28f260c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:42.425046 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2147f615-6fef-4bc7-b2a5-31a88be253aa tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:42.425650 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2147f615-6fef-4bc7-b2a5-31a88be253aa tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:42.431284 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2147f615-6fef-4bc7-b2a5-31a88be253aa tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:42.431728 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2147f615-6fef-4bc7-b2a5-31a88be253aa tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:42.432495 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2147f615-6fef-4bc7-b2a5-31a88be253aa tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:42.432916 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e175fef2-52fc-41f7-b18e-d80ab28f260c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:42.433074 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2147f615-6fef-4bc7-b2a5-31a88be253aa tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:42.434592 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e175fef2-52fc-41f7-b18e-d80ab28f260c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:42.435767 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e175fef2-52fc-41f7-b18e-d80ab28f260c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.252438 Jan 24 22:28:42.436691 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 68/137] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:42 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:42.578564 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2147f615-6fef-4bc7-b2a5-31a88be253aa tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:42.589793 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2147f615-6fef-4bc7-b2a5-31a88be253aa tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1362 microversion: 2.1 time: 0.168098 Jan 24 22:28:42.590377 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 70/138] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:42 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:43.435768 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-f6b284a8-a77f-42f5-96ee-7cc4eb9087db tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:43.436381 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-f6b284a8-a77f-42f5-96ee-7cc4eb9087db tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:43.443550 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f6b284a8-a77f-42f5-96ee-7cc4eb9087db tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:43.444001 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f6b284a8-a77f-42f5-96ee-7cc4eb9087db tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:43.445031 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f6b284a8-a77f-42f5-96ee-7cc4eb9087db tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:43.445480 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f6b284a8-a77f-42f5-96ee-7cc4eb9087db tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:43.453752 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6650ded8-5c7b-4500-b010-9e5208c12a52 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:43.454352 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6650ded8-5c7b-4500-b010-9e5208c12a52 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:43.460685 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6650ded8-5c7b-4500-b010-9e5208c12a52 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:43.461162 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6650ded8-5c7b-4500-b010-9e5208c12a52 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:43.461938 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6650ded8-5c7b-4500-b010-9e5208c12a52 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:43.462366 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6650ded8-5c7b-4500-b010-9e5208c12a52 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:43.686217 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-f6b284a8-a77f-42f5-96ee-7cc4eb9087db tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:43.698353 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6650ded8-5c7b-4500-b010-9e5208c12a52 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:43.702618 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-f6b284a8-a77f-42f5-96ee-7cc4eb9087db tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.270618 Jan 24 22:28:43.707848 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 69/139] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:43 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:28:43.716874 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6650ded8-5c7b-4500-b010-9e5208c12a52 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:43.716874 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6650ded8-5c7b-4500-b010-9e5208c12a52 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:43.716874 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6650ded8-5c7b-4500-b010-9e5208c12a52 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.265311 Jan 24 22:28:43.717279 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 71/140] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:43 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:28:43.719519 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-bb4fe10b-28e1-45f9-9bf4-56946856c6fa tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:43.720131 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-bb4fe10b-28e1-45f9-9bf4-56946856c6fa tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:43.726887 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bb4fe10b-28e1-45f9-9bf4-56946856c6fa tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:43.727625 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bb4fe10b-28e1-45f9-9bf4-56946856c6fa tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:43.728682 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bb4fe10b-28e1-45f9-9bf4-56946856c6fa tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:43.729241 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bb4fe10b-28e1-45f9-9bf4-56946856c6fa tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:43.874169 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-bb4fe10b-28e1-45f9-9bf4-56946856c6fa tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:43.881444 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-bb4fe10b-28e1-45f9-9bf4-56946856c6fa tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1548 microversion: 2.1 time: 0.171132 Jan 24 22:28:43.882015 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 70/141] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:43 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:43.898801 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2d4c57d0-c6ae-43da-8b04-fa006c3cf97f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:43.899527 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2d4c57d0-c6ae-43da-8b04-fa006c3cf97f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:43.905403 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2d4c57d0-c6ae-43da-8b04-fa006c3cf97f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:43.905857 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2d4c57d0-c6ae-43da-8b04-fa006c3cf97f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:43.906746 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2d4c57d0-c6ae-43da-8b04-fa006c3cf97f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:43.907192 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2d4c57d0-c6ae-43da-8b04-fa006c3cf97f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:43.989299 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2d4c57d0-c6ae-43da-8b04-fa006c3cf97f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094242 Jan 24 22:28:43.989894 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 72/142] 10.222.0.84 () {58 vars in 1274 bytes} [Mon Jan 24 22:28:43 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:28:44.724346 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-0cc2cf60-77a7-48af-94d5-f9eeef799004 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:44.725011 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-0cc2cf60-77a7-48af-94d5-f9eeef799004 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:44.732837 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0cc2cf60-77a7-48af-94d5-f9eeef799004 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:44.733524 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0cc2cf60-77a7-48af-94d5-f9eeef799004 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:44.734522 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0cc2cf60-77a7-48af-94d5-f9eeef799004 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:44.735096 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0cc2cf60-77a7-48af-94d5-f9eeef799004 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:44.735346 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4a313055-8c8a-4a4e-8db2-f76b9126321c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:44.736184 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4a313055-8c8a-4a4e-8db2-f76b9126321c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:44.744039 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4a313055-8c8a-4a4e-8db2-f76b9126321c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:44.744581 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4a313055-8c8a-4a4e-8db2-f76b9126321c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:44.745489 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4a313055-8c8a-4a4e-8db2-f76b9126321c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:44.745976 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4a313055-8c8a-4a4e-8db2-f76b9126321c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:44.956883 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4a313055-8c8a-4a4e-8db2-f76b9126321c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:44.966252 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-0cc2cf60-77a7-48af-94d5-f9eeef799004 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:44.975604 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-0cc2cf60-77a7-48af-94d5-f9eeef799004 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.254956 Jan 24 22:28:44.978898 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 71/143] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:44 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:44.983049 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4a313055-8c8a-4a4e-8db2-f76b9126321c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:44.984802 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4a313055-8c8a-4a4e-8db2-f76b9126321c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:44.986872 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4a313055-8c8a-4a4e-8db2-f76b9126321c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.256156 Jan 24 22:28:45.000645 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 73/144] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:44 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:45.404748 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e3834951-8d4c-404f-a13e-2775f09b2658 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:45.406456 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-72d8d0c6-be67-4080-be4b-50419abbe78f req-611eba97-29b0-4717-8307-97b3e9f2a33f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a250b35-2478-48ce-b61d-9eae8933d5fb", "tag": "1b9f98aa-61b7-471d-a113-b3ce2247724e"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:45.408082 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:28:45.408082 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:28:45.409930 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e3834951-8d4c-404f-a13e-2775f09b2658 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:45.423204 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-72d8d0c6-be67-4080-be4b-50419abbe78f req-611eba97-29b0-4717-8307-97b3e9f2a33f service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:45.424570 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3834951-8d4c-404f-a13e-2775f09b2658 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:45.425104 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3834951-8d4c-404f-a13e-2775f09b2658 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:45.426092 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3834951-8d4c-404f-a13e-2775f09b2658 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:45.426616 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3834951-8d4c-404f-a13e-2775f09b2658 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:45.427252 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-72d8d0c6-be67-4080-be4b-50419abbe78f req-611eba97-29b0-4717-8307-97b3e9f2a33f service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:45.451318 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-72d8d0c6-be67-4080-be4b-50419abbe78f req-611eba97-29b0-4717-8307-97b3e9f2a33f service nova] Creating event network-changed:1b9f98aa-61b7-471d-a113-b3ce2247724e for instance 3a250b35-2478-48ce-b61d-9eae8933d5fb on hv-cinder-81322 Jan 24 22:28:45.457958 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-72d8d0c6-be67-4080-be4b-50419abbe78f req-611eba97-29b0-4717-8307-97b3e9f2a33f service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059925 Jan 24 22:28:45.459153 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 74/145] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:28:45.995877 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-7a45b4d6-a885-4ef3-be20-b55ef6f13f26 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:45.996592 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-7a45b4d6-a885-4ef3-be20-b55ef6f13f26 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:46.006145 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7a45b4d6-a885-4ef3-be20-b55ef6f13f26 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:46.006554 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7a45b4d6-a885-4ef3-be20-b55ef6f13f26 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:46.007614 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7a45b4d6-a885-4ef3-be20-b55ef6f13f26 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:46.008345 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7a45b4d6-a885-4ef3-be20-b55ef6f13f26 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:46.155970 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7a45b4d6-a885-4ef3-be20-b55ef6f13f26 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:46.164205 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-7a45b4d6-a885-4ef3-be20-b55ef6f13f26 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.172469 Jan 24 22:28:46.164845 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 75/146] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:45 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:28:46.174592 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3a7d352c-57e9-4213-b422-dcdda2212453 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:46.175342 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-3a7d352c-57e9-4213-b422-dcdda2212453 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:46.181818 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3a7d352c-57e9-4213-b422-dcdda2212453 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:46.182351 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3a7d352c-57e9-4213-b422-dcdda2212453 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:46.183202 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3a7d352c-57e9-4213-b422-dcdda2212453 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:46.183636 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3a7d352c-57e9-4213-b422-dcdda2212453 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:46.321241 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3a7d352c-57e9-4213-b422-dcdda2212453 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:46.330810 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3a7d352c-57e9-4213-b422-dcdda2212453 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:46.332290 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3a7d352c-57e9-4213-b422-dcdda2212453 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:46.333464 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-3a7d352c-57e9-4213-b422-dcdda2212453 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.162768 Jan 24 22:28:46.334032 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 76/147] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:46 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:47.183726 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-92e96059-b92a-4c9a-9d1e-6d94a26a4f6e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:47.184570 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-92e96059-b92a-4c9a-9d1e-6d94a26a4f6e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:47.193366 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-92e96059-b92a-4c9a-9d1e-6d94a26a4f6e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:47.193876 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-92e96059-b92a-4c9a-9d1e-6d94a26a4f6e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:47.194909 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-92e96059-b92a-4c9a-9d1e-6d94a26a4f6e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:47.195516 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-92e96059-b92a-4c9a-9d1e-6d94a26a4f6e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:47.336772 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-92e96059-b92a-4c9a-9d1e-6d94a26a4f6e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:47.344842 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-92e96059-b92a-4c9a-9d1e-6d94a26a4f6e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.166419 Jan 24 22:28:47.347020 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 77/148] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:47 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:28:47.351365 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c2113463-3483-404f-a733-7c1031b919ac tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:47.353467 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c2113463-3483-404f-a733-7c1031b919ac tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:47.358284 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c2113463-3483-404f-a733-7c1031b919ac tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:47.358722 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c2113463-3483-404f-a733-7c1031b919ac tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:47.359477 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c2113463-3483-404f-a733-7c1031b919ac tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:47.359903 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c2113463-3483-404f-a733-7c1031b919ac tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:47.498431 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-c2113463-3483-404f-a733-7c1031b919ac tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:47.507754 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-c2113463-3483-404f-a733-7c1031b919ac tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:47.510138 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-c2113463-3483-404f-a733-7c1031b919ac tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:47.511271 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c2113463-3483-404f-a733-7c1031b919ac tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.163360 Jan 24 22:28:47.511849 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 78/149] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:47 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:47.535172 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e3834951-8d4c-404f-a13e-2775f09b2658 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 14 microversion: 2.1 time: 2.138793 Jan 24 22:28:47.536619 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 72/150] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:28:45 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 14 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 22:28:47.817224 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-9291739c-3d13-4aee-ac1c-28706310efa3 req-86e8fb63-c420-483b-86db-840606d5efd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a871432f-36c3-495a-8269-9de0a0e45315", "name": "network-vif-plugged", "status": "completed", "tag": "aabc5fed-da17-478f-810d-56ef4b5caa98"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:47.819021 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:28:47.819021 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:28:47.829482 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-9291739c-3d13-4aee-ac1c-28706310efa3 req-86e8fb63-c420-483b-86db-840606d5efd1 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:47.829942 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-9291739c-3d13-4aee-ac1c-28706310efa3 req-86e8fb63-c420-483b-86db-840606d5efd1 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:47.841517 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-9291739c-3d13-4aee-ac1c-28706310efa3 req-86e8fb63-c420-483b-86db-840606d5efd1 service nova] Creating event network-vif-plugged:aabc5fed-da17-478f-810d-56ef4b5caa98 for instance a871432f-36c3-495a-8269-9de0a0e45315 on hv-cinder-81322 Jan 24 22:28:47.846531 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-9291739c-3d13-4aee-ac1c-28706310efa3 req-86e8fb63-c420-483b-86db-840606d5efd1 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037255 Jan 24 22:28:47.847510 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 79/151] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:28:48.368074 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-d876368b-85b3-484b-b149-f0a5b6acc7d7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:48.368811 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d876368b-85b3-484b-b149-f0a5b6acc7d7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:48.376372 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d876368b-85b3-484b-b149-f0a5b6acc7d7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:48.376839 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d876368b-85b3-484b-b149-f0a5b6acc7d7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:48.377698 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d876368b-85b3-484b-b149-f0a5b6acc7d7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:48.378149 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d876368b-85b3-484b-b149-f0a5b6acc7d7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:48.516636 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d876368b-85b3-484b-b149-f0a5b6acc7d7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:48.525141 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-d876368b-85b3-484b-b149-f0a5b6acc7d7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.161854 Jan 24 22:28:48.526296 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 73/152] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:48 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:48.531767 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-5dd5eb16-33d8-482e-859a-5850ad19f46d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:48.533082 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-5dd5eb16-33d8-482e-859a-5850ad19f46d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:48.540829 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5dd5eb16-33d8-482e-859a-5850ad19f46d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:48.541497 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5dd5eb16-33d8-482e-859a-5850ad19f46d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:48.542465 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5dd5eb16-33d8-482e-859a-5850ad19f46d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:48.542898 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5dd5eb16-33d8-482e-859a-5850ad19f46d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:48.550094 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ce71eef9-69dc-4468-9168-19b89b035ca0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:48.551165 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ce71eef9-69dc-4468-9168-19b89b035ca0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:48.558274 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ce71eef9-69dc-4468-9168-19b89b035ca0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:48.558715 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ce71eef9-69dc-4468-9168-19b89b035ca0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:48.559692 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ce71eef9-69dc-4468-9168-19b89b035ca0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:48.560266 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ce71eef9-69dc-4468-9168-19b89b035ca0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:48.687050 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5dd5eb16-33d8-482e-859a-5850ad19f46d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:48.700656 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5dd5eb16-33d8-482e-859a-5850ad19f46d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:48.703171 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5dd5eb16-33d8-482e-859a-5850ad19f46d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:48.704896 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-5dd5eb16-33d8-482e-859a-5850ad19f46d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.177418 Jan 24 22:28:48.705810 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 80/153] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:48 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:49.544474 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-55ab9055-24d1-4e79-b463-43784de16686 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:49.545327 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-55ab9055-24d1-4e79-b463-43784de16686 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:49.553513 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-55ab9055-24d1-4e79-b463-43784de16686 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:49.554176 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-55ab9055-24d1-4e79-b463-43784de16686 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:49.555237 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-55ab9055-24d1-4e79-b463-43784de16686 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:49.555709 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-55ab9055-24d1-4e79-b463-43784de16686 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:49.696870 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-55ab9055-24d1-4e79-b463-43784de16686 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:49.704195 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-55ab9055-24d1-4e79-b463-43784de16686 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.164389 Jan 24 22:28:49.704758 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 81/154] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:49 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:49.723862 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-5ea87de9-a352-4a55-93d4-5758b4468d32 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:49.724477 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-5ea87de9-a352-4a55-93d4-5758b4468d32 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:49.730427 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5ea87de9-a352-4a55-93d4-5758b4468d32 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:49.730865 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5ea87de9-a352-4a55-93d4-5758b4468d32 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:49.731614 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5ea87de9-a352-4a55-93d4-5758b4468d32 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:49.732036 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5ea87de9-a352-4a55-93d4-5758b4468d32 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:49.869446 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5ea87de9-a352-4a55-93d4-5758b4468d32 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:49.877276 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5ea87de9-a352-4a55-93d4-5758b4468d32 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:49.878756 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5ea87de9-a352-4a55-93d4-5758b4468d32 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:49.879828 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-5ea87de9-a352-4a55-93d4-5758b4468d32 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.159315 Jan 24 22:28:49.880364 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 82/155] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:49 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:49.884673 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-77af593e-6b16-4330-9645-ce5716e2ef28 req-69dc2928-59df-4e0d-91f8-2054c0cae453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5995cfc4-026f-45ae-a918-0bc8f1bdc025", "name": "network-vif-plugged", "status": "completed", "tag": "987c8810-0969-4e25-bb03-7993afce108d"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:49.886241 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:28:49.886241 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:28:49.893603 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-77af593e-6b16-4330-9645-ce5716e2ef28 req-69dc2928-59df-4e0d-91f8-2054c0cae453 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:49.894030 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-77af593e-6b16-4330-9645-ce5716e2ef28 req-69dc2928-59df-4e0d-91f8-2054c0cae453 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:49.905435 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-77af593e-6b16-4330-9645-ce5716e2ef28 req-69dc2928-59df-4e0d-91f8-2054c0cae453 service nova] Creating event network-vif-plugged:987c8810-0969-4e25-bb03-7993afce108d for instance 5995cfc4-026f-45ae-a918-0bc8f1bdc025 on hv-cinder-81322 Jan 24 22:28:49.910263 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-77af593e-6b16-4330-9645-ce5716e2ef28 req-69dc2928-59df-4e0d-91f8-2054c0cae453 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028833 Jan 24 22:28:49.910857 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 83/156] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:28:50.722426 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f42933e6-06d5-49bd-a41f-e00bb2ef496f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:50.723113 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-f42933e6-06d5-49bd-a41f-e00bb2ef496f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:50.729543 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f42933e6-06d5-49bd-a41f-e00bb2ef496f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:50.730055 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f42933e6-06d5-49bd-a41f-e00bb2ef496f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:50.730819 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f42933e6-06d5-49bd-a41f-e00bb2ef496f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:50.731244 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f42933e6-06d5-49bd-a41f-e00bb2ef496f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:50.871621 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-f42933e6-06d5-49bd-a41f-e00bb2ef496f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:50.879402 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-f42933e6-06d5-49bd-a41f-e00bb2ef496f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.161565 Jan 24 22:28:50.879974 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 84/157] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:50 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:50.897846 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-398d7e65-df1e-4b69-a9ce-551e78ada02a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:50.898909 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-398d7e65-df1e-4b69-a9ce-551e78ada02a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:50.905308 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-398d7e65-df1e-4b69-a9ce-551e78ada02a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:50.905778 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-398d7e65-df1e-4b69-a9ce-551e78ada02a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:50.906596 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-398d7e65-df1e-4b69-a9ce-551e78ada02a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:50.906973 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-398d7e65-df1e-4b69-a9ce-551e78ada02a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:50.945524 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ce71eef9-69dc-4468-9168-19b89b035ca0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 14 microversion: 2.1 time: 2.398611 Jan 24 22:28:50.946399 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 74/158] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:28:48 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 14 bytes in 2401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 22:28:51.051843 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-398d7e65-df1e-4b69-a9ce-551e78ada02a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:51.060221 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-398d7e65-df1e-4b69-a9ce-551e78ada02a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:51.061754 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-398d7e65-df1e-4b69-a9ce-551e78ada02a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:51.062860 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-398d7e65-df1e-4b69-a9ce-551e78ada02a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.168923 Jan 24 22:28:51.063739 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 85/159] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:50 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:51.898084 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6dc3e5a1-6b66-4ac0-8f7b-7487f0ccc101 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:51.898787 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6dc3e5a1-6b66-4ac0-8f7b-7487f0ccc101 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:51.905843 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6dc3e5a1-6b66-4ac0-8f7b-7487f0ccc101 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:51.906342 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6dc3e5a1-6b66-4ac0-8f7b-7487f0ccc101 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:51.907117 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6dc3e5a1-6b66-4ac0-8f7b-7487f0ccc101 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:51.907549 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6dc3e5a1-6b66-4ac0-8f7b-7487f0ccc101 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:51.924597 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-64f0fb26-d13a-415c-bd24-415eeda0ac4d req-acc5f2f6-1c3e-4cc0-9974-392689c94d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4044f2ed-7e33-45cf-9b1b-6447f372c243", "name": "network-vif-plugged", "status": "completed", "tag": "80c7633d-9102-4911-954f-6788c2d7bbcc"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:51.926188 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:28:51.926188 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:28:51.933990 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-64f0fb26-d13a-415c-bd24-415eeda0ac4d req-acc5f2f6-1c3e-4cc0-9974-392689c94d6b service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:51.936399 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-64f0fb26-d13a-415c-bd24-415eeda0ac4d req-acc5f2f6-1c3e-4cc0-9974-392689c94d6b service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:51.950196 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-64f0fb26-d13a-415c-bd24-415eeda0ac4d req-acc5f2f6-1c3e-4cc0-9974-392689c94d6b service nova] Creating event network-vif-plugged:80c7633d-9102-4911-954f-6788c2d7bbcc for instance 4044f2ed-7e33-45cf-9b1b-6447f372c243 on hv-cinder-81322 Jan 24 22:28:51.968808 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-64f0fb26-d13a-415c-bd24-415eeda0ac4d req-acc5f2f6-1c3e-4cc0-9974-392689c94d6b service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038431 Jan 24 22:28:51.969974 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 86/160] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:28:51.976002 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-19a2ba70-0be4-4d03-ad4d-f4114a0dd47f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:51.977950 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-19a2ba70-0be4-4d03-ad4d-f4114a0dd47f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:51.984274 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-19a2ba70-0be4-4d03-ad4d-f4114a0dd47f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:51.984802 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-19a2ba70-0be4-4d03-ad4d-f4114a0dd47f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:51.985674 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-19a2ba70-0be4-4d03-ad4d-f4114a0dd47f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:51.986169 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-19a2ba70-0be4-4d03-ad4d-f4114a0dd47f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:52.053673 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-6dc3e5a1-6b66-4ac0-8f7b-7487f0ccc101 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:52.061067 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6dc3e5a1-6b66-4ac0-8f7b-7487f0ccc101 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.167085 Jan 24 22:28:52.061644 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 75/161] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:51 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:52.081352 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2e2e2857-07d2-4329-b662-45ed2f2054b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:52.082017 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2e2e2857-07d2-4329-b662-45ed2f2054b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:52.088347 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2e2e2857-07d2-4329-b662-45ed2f2054b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:52.088785 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2e2e2857-07d2-4329-b662-45ed2f2054b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:52.089569 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2e2e2857-07d2-4329-b662-45ed2f2054b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:52.090683 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2e2e2857-07d2-4329-b662-45ed2f2054b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:52.432501 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-2e2e2857-07d2-4329-b662-45ed2f2054b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:52.443563 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-2e2e2857-07d2-4329-b662-45ed2f2054b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:52.446048 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-2e2e2857-07d2-4329-b662-45ed2f2054b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:52.447349 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2e2e2857-07d2-4329-b662-45ed2f2054b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.369842 Jan 24 22:28:52.449016 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 76/162] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:52 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:53.079072 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-384185f1-87fc-4515-ac11-ff384a7fcadd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:53.079703 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-384185f1-87fc-4515-ac11-ff384a7fcadd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:53.086324 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-384185f1-87fc-4515-ac11-ff384a7fcadd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:53.086776 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-384185f1-87fc-4515-ac11-ff384a7fcadd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:53.087571 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-384185f1-87fc-4515-ac11-ff384a7fcadd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:53.087995 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-384185f1-87fc-4515-ac11-ff384a7fcadd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:53.227605 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-384185f1-87fc-4515-ac11-ff384a7fcadd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:53.234927 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-384185f1-87fc-4515-ac11-ff384a7fcadd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.159423 Jan 24 22:28:53.235495 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 77/163] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:53 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:53.466297 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-04439d02-16d7-4ba7-b10c-3f36e57c633a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:53.466898 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-04439d02-16d7-4ba7-b10c-3f36e57c633a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:53.473420 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-04439d02-16d7-4ba7-b10c-3f36e57c633a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:53.473864 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-04439d02-16d7-4ba7-b10c-3f36e57c633a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:53.474656 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-04439d02-16d7-4ba7-b10c-3f36e57c633a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:53.477242 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-04439d02-16d7-4ba7-b10c-3f36e57c633a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:53.616175 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-04439d02-16d7-4ba7-b10c-3f36e57c633a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:53.624815 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-04439d02-16d7-4ba7-b10c-3f36e57c633a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:53.626364 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-04439d02-16d7-4ba7-b10c-3f36e57c633a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:53.627503 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-04439d02-16d7-4ba7-b10c-3f36e57c633a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.165007 Jan 24 22:28:53.628236 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 78/164] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:53 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:54.252051 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-0f4eee5b-2a21-487a-ae9d-6fbabad4e038 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:54.252730 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-0f4eee5b-2a21-487a-ae9d-6fbabad4e038 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:54.259780 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0f4eee5b-2a21-487a-ae9d-6fbabad4e038 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:54.260208 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0f4eee5b-2a21-487a-ae9d-6fbabad4e038 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:54.260976 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0f4eee5b-2a21-487a-ae9d-6fbabad4e038 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:54.261428 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0f4eee5b-2a21-487a-ae9d-6fbabad4e038 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:54.540393 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-0f4eee5b-2a21-487a-ae9d-6fbabad4e038 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:54.547759 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-0f4eee5b-2a21-487a-ae9d-6fbabad4e038 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.299544 Jan 24 22:28:54.548319 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 79/165] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:54 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:28:54.645961 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-04ceb77c-2bfd-4e89-a96b-132f70789336 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:54.646486 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-04ceb77c-2bfd-4e89-a96b-132f70789336 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:54.652680 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-04ceb77c-2bfd-4e89-a96b-132f70789336 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:54.653158 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-04ceb77c-2bfd-4e89-a96b-132f70789336 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:54.653925 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-04ceb77c-2bfd-4e89-a96b-132f70789336 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:54.654351 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-04ceb77c-2bfd-4e89-a96b-132f70789336 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:54.789443 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-04ceb77c-2bfd-4e89-a96b-132f70789336 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:54.797386 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-04ceb77c-2bfd-4e89-a96b-132f70789336 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:54.798861 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-04ceb77c-2bfd-4e89-a96b-132f70789336 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:54.800014 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-04ceb77c-2bfd-4e89-a96b-132f70789336 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.157979 Jan 24 22:28:54.800533 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 80/166] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:54 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:28:54.813102 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-19a2ba70-0be4-4d03-ad4d-f4114a0dd47f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 14 microversion: 2.1 time: 2.841616 Jan 24 22:28:54.813769 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 87/167] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:28:51 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 14 bytes in 2843 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 22:28:55.563589 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-041944cd-c5dd-40a7-be11-5d3f52bc61b7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:55.564370 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-041944cd-c5dd-40a7-be11-5d3f52bc61b7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:55.571838 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-041944cd-c5dd-40a7-be11-5d3f52bc61b7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:55.572321 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-041944cd-c5dd-40a7-be11-5d3f52bc61b7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:55.573145 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-041944cd-c5dd-40a7-be11-5d3f52bc61b7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:55.573607 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-041944cd-c5dd-40a7-be11-5d3f52bc61b7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:55.711876 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-041944cd-c5dd-40a7-be11-5d3f52bc61b7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:55.719546 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-041944cd-c5dd-40a7-be11-5d3f52bc61b7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.159570 Jan 24 22:28:55.720120 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 81/168] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:55 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:55.820391 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4b2a8b0e-244a-49af-88c0-0d28ba9c236f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:55.821975 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4b2a8b0e-244a-49af-88c0-0d28ba9c236f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:55.824606 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-0ed8442d-8bc9-48f9-9b5b-1cc4f68468f8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:55.826002 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-0ed8442d-8bc9-48f9-9b5b-1cc4f68468f8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:55.829262 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4b2a8b0e-244a-49af-88c0-0d28ba9c236f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:55.829937 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4b2a8b0e-244a-49af-88c0-0d28ba9c236f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:55.831002 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4b2a8b0e-244a-49af-88c0-0d28ba9c236f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:55.831557 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4b2a8b0e-244a-49af-88c0-0d28ba9c236f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:55.833950 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0ed8442d-8bc9-48f9-9b5b-1cc4f68468f8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:55.834394 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0ed8442d-8bc9-48f9-9b5b-1cc4f68468f8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:55.835262 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0ed8442d-8bc9-48f9-9b5b-1cc4f68468f8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:55.837372 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0ed8442d-8bc9-48f9-9b5b-1cc4f68468f8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:56.018364 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4b2a8b0e-244a-49af-88c0-0d28ba9c236f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:56.030575 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4b2a8b0e-244a-49af-88c0-0d28ba9c236f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:56.033147 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4b2a8b0e-244a-49af-88c0-0d28ba9c236f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:56.034331 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4b2a8b0e-244a-49af-88c0-0d28ba9c236f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1404 microversion: 2.20 time: 0.219026 Jan 24 22:28:56.035251 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 88/169] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:55 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1404 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:56.144640 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-0ed8442d-8bc9-48f9-9b5b-1cc4f68468f8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 14 microversion: 2.1 time: 0.323783 Jan 24 22:28:56.145403 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 82/170] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:28:55 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 14 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 22:28:56.739158 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-5f72de5e-df46-4fc1-94d7-c1038e333a14 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:56.739986 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-5f72de5e-df46-4fc1-94d7-c1038e333a14 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:56.749582 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5f72de5e-df46-4fc1-94d7-c1038e333a14 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:56.750116 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5f72de5e-df46-4fc1-94d7-c1038e333a14 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:56.751341 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5f72de5e-df46-4fc1-94d7-c1038e333a14 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:56.751903 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5f72de5e-df46-4fc1-94d7-c1038e333a14 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:56.887401 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5f72de5e-df46-4fc1-94d7-c1038e333a14 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:56.895456 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-5f72de5e-df46-4fc1-94d7-c1038e333a14 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1322 microversion: 2.1 time: 0.162223 Jan 24 22:28:56.896021 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 89/171] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:56 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:57.053333 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b7f7e042-e6ad-4f2f-a972-7d4731e8b092 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:57.054685 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b7f7e042-e6ad-4f2f-a972-7d4731e8b092 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:57.063139 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b7f7e042-e6ad-4f2f-a972-7d4731e8b092 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:57.063626 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b7f7e042-e6ad-4f2f-a972-7d4731e8b092 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:57.064372 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b7f7e042-e6ad-4f2f-a972-7d4731e8b092 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:57.064807 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b7f7e042-e6ad-4f2f-a972-7d4731e8b092 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:57.155871 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-d3f8dc04-c53a-42af-ba24-517fa34fae7d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:57.156843 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-d3f8dc04-c53a-42af-ba24-517fa34fae7d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:57.165505 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d3f8dc04-c53a-42af-ba24-517fa34fae7d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:57.166187 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d3f8dc04-c53a-42af-ba24-517fa34fae7d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:57.167562 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d3f8dc04-c53a-42af-ba24-517fa34fae7d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:57.168080 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d3f8dc04-c53a-42af-ba24-517fa34fae7d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:57.233687 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b7f7e042-e6ad-4f2f-a972-7d4731e8b092 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:57.242295 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b7f7e042-e6ad-4f2f-a972-7d4731e8b092 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:57.243922 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b7f7e042-e6ad-4f2f-a972-7d4731e8b092 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:57.245101 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b7f7e042-e6ad-4f2f-a972-7d4731e8b092 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1596 microversion: 2.20 time: 0.196909 Jan 24 22:28:57.245658 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 83/172] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:28:57 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1596 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:28:57.263185 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-f500dcbb-7dcc-42f2-9ce2-f74f35c91e59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:57.263672 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-f500dcbb-7dcc-42f2-9ce2-f74f35c91e59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:57.271464 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f500dcbb-7dcc-42f2-9ce2-f74f35c91e59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:57.272032 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f500dcbb-7dcc-42f2-9ce2-f74f35c91e59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:57.273113 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f500dcbb-7dcc-42f2-9ce2-f74f35c91e59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:57.273899 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f500dcbb-7dcc-42f2-9ce2-f74f35c91e59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:57.383310 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-f500dcbb-7dcc-42f2-9ce2-f74f35c91e59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.122410 Jan 24 22:28:57.383916 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 84/173] 10.222.0.84 () {60 vars in 1315 bytes} [Mon Jan 24 22:28:57 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:28:57.524066 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-d3f8dc04-c53a-42af-ba24-517fa34fae7d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 14 microversion: 2.1 time: 0.371501 Jan 24 22:28:57.524696 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 90/174] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:28:57 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 14 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 22:28:57.912435 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e3283a5f-2f0a-4fa9-8206-585511446652 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:57.913202 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e3283a5f-2f0a-4fa9-8206-585511446652 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:57.920298 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3283a5f-2f0a-4fa9-8206-585511446652 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:57.920747 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3283a5f-2f0a-4fa9-8206-585511446652 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:57.921612 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3283a5f-2f0a-4fa9-8206-585511446652 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:57.922045 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3283a5f-2f0a-4fa9-8206-585511446652 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:58.215134 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e3283a5f-2f0a-4fa9-8206-585511446652 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:58.223703 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e3283a5f-2f0a-4fa9-8206-585511446652 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1516 microversion: 2.1 time: 0.315318 Jan 24 22:28:58.224155 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 85/175] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:57 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1516 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:58.241750 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0612df29-f91a-4b43-ad68-f033aaa34365 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:58.243331 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0612df29-f91a-4b43-ad68-f033aaa34365 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:58.250374 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0612df29-f91a-4b43-ad68-f033aaa34365 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:58.250813 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0612df29-f91a-4b43-ad68-f033aaa34365 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:58.251742 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0612df29-f91a-4b43-ad68-f033aaa34365 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:58.252172 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0612df29-f91a-4b43-ad68-f033aaa34365 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:58.276158 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-0612df29-f91a-4b43-ad68-f033aaa34365 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lazy-loading 'flavor' on Instance uuid 4044f2ed-7e33-45cf-9b1b-6447f372c243 {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:28:58.401839 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0612df29-f91a-4b43-ad68-f033aaa34365 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "POST /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243/action" status: 200 len: 32 microversion: 2.1 time: 0.164203 Jan 24 22:28:58.402450 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 91/176] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:28:58 2022] POST /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 22:28:58.411594 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-18d886a5-3971-49ea-8198-e0ec2e7db6f3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:58.412151 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-18d886a5-3971-49ea-8198-e0ec2e7db6f3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:58.418814 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-18d886a5-3971-49ea-8198-e0ec2e7db6f3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:58.419262 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-18d886a5-3971-49ea-8198-e0ec2e7db6f3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:58.420052 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-18d886a5-3971-49ea-8198-e0ec2e7db6f3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:58.420479 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-18d886a5-3971-49ea-8198-e0ec2e7db6f3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:58.542616 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-5e4f6504-153c-45ca-99cf-8f54c8e66053 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:58.543957 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-5e4f6504-153c-45ca-99cf-8f54c8e66053 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:58.554845 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5e4f6504-153c-45ca-99cf-8f54c8e66053 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:58.555502 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5e4f6504-153c-45ca-99cf-8f54c8e66053 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:58.556457 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5e4f6504-153c-45ca-99cf-8f54c8e66053 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:58.557044 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5e4f6504-153c-45ca-99cf-8f54c8e66053 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:58.677264 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-5e4f6504-153c-45ca-99cf-8f54c8e66053 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 14 microversion: 2.1 time: 0.138312 Jan 24 22:28:58.683742 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 92/177] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:28:58 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 22:28:58.720773 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-410e3d44-068b-481e-b8b1-5b6fe9fe4821 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-345462018", "imageRef": "4fe12948-6887-4759-900b-f3ee39409e75", "flavorRef": "452", "networks": [{"uuid": "e8ede52f-f77b-4695-9cf8-08051f1c017e"}]}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:58.790549 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.network.neutron [None req-410e3d44-068b-481e-b8b1-5b6fe9fe4821 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] validate_networks() for [('e8ede52f-f77b-4695-9cf8-08051f1c017e', None, None, None, None, None)] {{(pid=116467) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:28:58.881012 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-18d886a5-3971-49ea-8198-e0ec2e7db6f3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:58.896329 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-18d886a5-3971-49ea-8198-e0ec2e7db6f3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.488296 Jan 24 22:28:58.898085 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 86/178] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:58 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:59.234413 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-aa5d8f46-25e2-4904-9d1d-2cea7c3020cb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:59.235962 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-aa5d8f46-25e2-4904-9d1d-2cea7c3020cb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:59.244429 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-aa5d8f46-25e2-4904-9d1d-2cea7c3020cb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:59.249607 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-aa5d8f46-25e2-4904-9d1d-2cea7c3020cb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:59.250505 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-aa5d8f46-25e2-4904-9d1d-2cea7c3020cb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:59.250885 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-aa5d8f46-25e2-4904-9d1d-2cea7c3020cb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:59.421513 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-410e3d44-068b-481e-b8b1-5b6fe9fe4821 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Flavor limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:28:59.422013 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-410e3d44-068b-481e-b8b1-5b6fe9fe4821 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Image limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:28:59.422377 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-410e3d44-068b-481e-b8b1-5b6fe9fe4821 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Flavor pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:28:59.422778 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-410e3d44-068b-481e-b8b1-5b6fe9fe4821 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Image pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:28:59.423245 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-410e3d44-068b-481e-b8b1-5b6fe9fe4821 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:28:59.429687 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-aa5d8f46-25e2-4904-9d1d-2cea7c3020cb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 14 microversion: 2.20 time: 0.198958 Jan 24 22:28:59.430676 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 87/179] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:28:59 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:28:59.435747 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-958297c5-c9a3-47bd-8c76-87103c5ac8d0 req-4d1bcdcd-de23-4387-9f85-c0361a5b815f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5995cfc4-026f-45ae-a918-0bc8f1bdc025", "tag": "987c8810-0969-4e25-bb03-7993afce108d"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:59.437443 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:28:59.437443 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:28:59.445386 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-958297c5-c9a3-47bd-8c76-87103c5ac8d0 req-4d1bcdcd-de23-4387-9f85-c0361a5b815f service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:59.446047 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-958297c5-c9a3-47bd-8c76-87103c5ac8d0 req-4d1bcdcd-de23-4387-9f85-c0361a5b815f service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:59.446343 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-410e3d44-068b-481e-b8b1-5b6fe9fe4821 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:59.447723 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-410e3d44-068b-481e-b8b1-5b6fe9fe4821 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:59.448539 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-410e3d44-068b-481e-b8b1-5b6fe9fe4821 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:59.453493 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-410e3d44-068b-481e-b8b1-5b6fe9fe4821 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:59.457439 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-958297c5-c9a3-47bd-8c76-87103c5ac8d0 req-4d1bcdcd-de23-4387-9f85-c0361a5b815f service nova] Creating event network-changed:987c8810-0969-4e25-bb03-7993afce108d for instance 5995cfc4-026f-45ae-a918-0bc8f1bdc025 on hv-cinder-81322 Jan 24 22:28:59.462432 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-958297c5-c9a3-47bd-8c76-87103c5ac8d0 req-4d1bcdcd-de23-4387-9f85-c0361a5b815f service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030292 Jan 24 22:28:59.463915 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 88/180] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:28:59.476062 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-410e3d44-068b-481e-b8b1-5b6fe9fe4821 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Getting quotas for project a78218846bb84713b4c02d9f95a25250. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:28:59.480614 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-410e3d44-068b-481e-b8b1-5b6fe9fe4821 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Getting quotas for user a0f51c8d0b8c4cc5ab76dae765c1b1c9 and project a78218846bb84713b4c02d9f95a25250. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:28:59.492563 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-410e3d44-068b-481e-b8b1-5b6fe9fe4821 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Going to run 1 instances... {{(pid=116467) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:28:59.495720 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-410e3d44-068b-481e-b8b1-5b6fe9fe4821 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fe12948-6887-4759-900b-f3ee39409e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:28:59.547151 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-410e3d44-068b-481e-b8b1-5b6fe9fe4821 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.832371 Jan 24 22:28:59.548416 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 93/181] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:28:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 24 22:28:59.558948 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c58081fa-d6c7-4eed-93cf-e9ee2d2ee946 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:59.559650 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c58081fa-d6c7-4eed-93cf-e9ee2d2ee946 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:59.614848 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c58081fa-d6c7-4eed-93cf-e9ee2d2ee946 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:28:59.621925 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c58081fa-d6c7-4eed-93cf-e9ee2d2ee946 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 200 len: 1217 microversion: 2.1 time: 0.067902 Jan 24 22:28:59.622727 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 89/182] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:59 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:28:59.691369 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-81e9b214-27b4-42e1-9b97-72a3214aa684 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:28:59.692634 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-81e9b214-27b4-42e1-9b97-72a3214aa684 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:59.707238 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-81e9b214-27b4-42e1-9b97-72a3214aa684 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:59.710135 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-81e9b214-27b4-42e1-9b97-72a3214aa684 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:59.713075 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-81e9b214-27b4-42e1-9b97-72a3214aa684 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:59.713677 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-81e9b214-27b4-42e1-9b97-72a3214aa684 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:59.915635 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-bd21ccbc-f602-4482-b054-586daf3de268 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:28:59.916142 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-bd21ccbc-f602-4482-b054-586daf3de268 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:28:59.929457 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bd21ccbc-f602-4482-b054-586daf3de268 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:59.930141 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bd21ccbc-f602-4482-b054-586daf3de268 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:28:59.931704 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bd21ccbc-f602-4482-b054-586daf3de268 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:28:59.932286 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bd21ccbc-f602-4482-b054-586daf3de268 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:00.014858 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-81e9b214-27b4-42e1-9b97-72a3214aa684 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 14 microversion: 2.1 time: 0.327563 Jan 24 22:29:00.018289 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 94/183] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:28:59 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 14 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 22:29:00.223375 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-bd21ccbc-f602-4482-b054-586daf3de268 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:00.235594 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-bd21ccbc-f602-4482-b054-586daf3de268 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.324229 Jan 24 22:29:00.236570 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 90/184] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:28:59 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:00.443469 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6db0e16d-11d5-4d4f-b39e-08e094013dc0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:00.444277 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6db0e16d-11d5-4d4f-b39e-08e094013dc0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:00.452590 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6db0e16d-11d5-4d4f-b39e-08e094013dc0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:00.453158 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6db0e16d-11d5-4d4f-b39e-08e094013dc0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:00.454086 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6db0e16d-11d5-4d4f-b39e-08e094013dc0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:00.454671 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6db0e16d-11d5-4d4f-b39e-08e094013dc0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:00.640948 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ef33f828-edcc-44c0-b3b5-15a224e94318 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:00.641858 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ef33f828-edcc-44c0-b3b5-15a224e94318 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:00.655891 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ef33f828-edcc-44c0-b3b5-15a224e94318 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:00.657497 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ef33f828-edcc-44c0-b3b5-15a224e94318 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:00.658558 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ef33f828-edcc-44c0-b3b5-15a224e94318 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:00.661438 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ef33f828-edcc-44c0-b3b5-15a224e94318 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:00.706299 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6db0e16d-11d5-4d4f-b39e-08e094013dc0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 14 microversion: 2.20 time: 0.267920 Jan 24 22:29:00.707316 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 95/185] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:00 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 14 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:00.790550 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ef33f828-edcc-44c0-b3b5-15a224e94318 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:00.820694 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ef33f828-edcc-44c0-b3b5-15a224e94318 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 200 len: 1269 microversion: 2.1 time: 0.177983 Jan 24 22:29:00.822537 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 91/186] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:00 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 1269 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:01.027448 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6fcbb96e-6f6f-4997-832a-6ca9f62bdeba tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:01.028414 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6fcbb96e-6f6f-4997-832a-6ca9f62bdeba tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:01.036622 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6fcbb96e-6f6f-4997-832a-6ca9f62bdeba tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:01.037113 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6fcbb96e-6f6f-4997-832a-6ca9f62bdeba tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:01.037903 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6fcbb96e-6f6f-4997-832a-6ca9f62bdeba tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:01.038463 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6fcbb96e-6f6f-4997-832a-6ca9f62bdeba tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:01.215151 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6fcbb96e-6f6f-4997-832a-6ca9f62bdeba tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 4153 microversion: 2.1 time: 0.191814 Jan 24 22:29:01.215846 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 96/187] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:01 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 4153 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:01.252636 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-107163a5-3154-4622-97a4-549ee82d4dbb tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:01.253593 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-107163a5-3154-4622-97a4-549ee82d4dbb tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:01.262469 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-107163a5-3154-4622-97a4-549ee82d4dbb tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:01.265784 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-107163a5-3154-4622-97a4-549ee82d4dbb tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:01.266685 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-107163a5-3154-4622-97a4-549ee82d4dbb tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:01.267186 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-107163a5-3154-4622-97a4-549ee82d4dbb tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:01.498002 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-107163a5-3154-4622-97a4-549ee82d4dbb tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:01.508416 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-107163a5-3154-4622-97a4-549ee82d4dbb tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.259322 Jan 24 22:29:01.509010 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 92/188] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:01 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:01.721342 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-cf63eb7a-1105-4b3b-be8c-788966498017 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:01.722541 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-cf63eb7a-1105-4b3b-be8c-788966498017 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:01.737535 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cf63eb7a-1105-4b3b-be8c-788966498017 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:01.737982 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cf63eb7a-1105-4b3b-be8c-788966498017 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:01.740419 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cf63eb7a-1105-4b3b-be8c-788966498017 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:01.741609 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cf63eb7a-1105-4b3b-be8c-788966498017 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:01.838797 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c64ec0ac-00d7-4036-a504-41bfd3e786ea tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:01.839556 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c64ec0ac-00d7-4036-a504-41bfd3e786ea tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:01.852086 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c64ec0ac-00d7-4036-a504-41bfd3e786ea tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:01.852679 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c64ec0ac-00d7-4036-a504-41bfd3e786ea tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:01.853569 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c64ec0ac-00d7-4036-a504-41bfd3e786ea tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:01.853980 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c64ec0ac-00d7-4036-a504-41bfd3e786ea tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:01.916719 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-cf63eb7a-1105-4b3b-be8c-788966498017 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 14 microversion: 2.20 time: 0.200563 Jan 24 22:29:01.917653 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 97/189] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:01 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 14 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:01.954756 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c64ec0ac-00d7-4036-a504-41bfd3e786ea tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:01.965171 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c64ec0ac-00d7-4036-a504-41bfd3e786ea tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 200 len: 1275 microversion: 2.1 time: 0.130695 Jan 24 22:29:01.966168 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 93/190] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:01 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 1275 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:02.227030 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-5da08d44-4467-4fd2-802a-dc56ddb0d2cc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:02.228299 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-5da08d44-4467-4fd2-802a-dc56ddb0d2cc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:02.235606 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5da08d44-4467-4fd2-802a-dc56ddb0d2cc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:02.236290 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5da08d44-4467-4fd2-802a-dc56ddb0d2cc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:02.237270 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5da08d44-4467-4fd2-802a-dc56ddb0d2cc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:02.237842 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5da08d44-4467-4fd2-802a-dc56ddb0d2cc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:02.401025 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-5da08d44-4467-4fd2-802a-dc56ddb0d2cc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 9658 microversion: 2.1 time: 0.178144 Jan 24 22:29:02.402021 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 98/191] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:02 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 9658 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:02.530277 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-bec72188-a017-4dab-8024-95881ccc7e8f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:02.531251 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-bec72188-a017-4dab-8024-95881ccc7e8f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:02.545047 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bec72188-a017-4dab-8024-95881ccc7e8f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:02.547134 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bec72188-a017-4dab-8024-95881ccc7e8f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:02.548150 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bec72188-a017-4dab-8024-95881ccc7e8f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:02.549515 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bec72188-a017-4dab-8024-95881ccc7e8f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:02.808905 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-bec72188-a017-4dab-8024-95881ccc7e8f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:02.818895 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-bec72188-a017-4dab-8024-95881ccc7e8f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.295959 Jan 24 22:29:02.821389 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 94/192] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:02 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:02.930235 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1e5201cc-ea43-4ab5-9ffa-e2fd4e442165 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:02.932004 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1e5201cc-ea43-4ab5-9ffa-e2fd4e442165 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:02.942743 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1e5201cc-ea43-4ab5-9ffa-e2fd4e442165 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:02.943188 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1e5201cc-ea43-4ab5-9ffa-e2fd4e442165 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:02.945772 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1e5201cc-ea43-4ab5-9ffa-e2fd4e442165 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:02.950002 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1e5201cc-ea43-4ab5-9ffa-e2fd4e442165 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:02.983010 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c1e70281-2c2c-45cb-84ac-0ad026005954 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:02.983620 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c1e70281-2c2c-45cb-84ac-0ad026005954 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:02.992363 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c1e70281-2c2c-45cb-84ac-0ad026005954 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:02.992807 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c1e70281-2c2c-45cb-84ac-0ad026005954 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:02.993642 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c1e70281-2c2c-45cb-84ac-0ad026005954 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:02.994053 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c1e70281-2c2c-45cb-84ac-0ad026005954 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:03.152219 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1e5201cc-ea43-4ab5-9ffa-e2fd4e442165 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 14 microversion: 2.20 time: 0.227190 Jan 24 22:29:03.152855 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 99/193] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:02 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 14 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:03.219128 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c1e70281-2c2c-45cb-84ac-0ad026005954 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:03.230350 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c1e70281-2c2c-45cb-84ac-0ad026005954 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 200 len: 1317 microversion: 2.1 time: 0.252187 Jan 24 22:29:03.240397 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 95/194] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:02 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:03.413840 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-85c26e0c-3612-4579-9447-6a367ce61063 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:03.415444 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-85c26e0c-3612-4579-9447-6a367ce61063 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:03.423256 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-85c26e0c-3612-4579-9447-6a367ce61063 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:03.423684 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-85c26e0c-3612-4579-9447-6a367ce61063 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:03.424495 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-85c26e0c-3612-4579-9447-6a367ce61063 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:03.425759 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-85c26e0c-3612-4579-9447-6a367ce61063 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:03.489524 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-b090bdc7-ab69-4d1e-80c5-14d324fb4e0f req-889a2a45-5176-4641-b560-7ef7e7c46782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158b5aec-4d57-487e-8205-e4598e66020c", "tag": "ca679ea3-bdcd-4fab-8f2e-e0ba60316285"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:03.491187 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:29:03.491187 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:29:03.499368 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-b090bdc7-ab69-4d1e-80c5-14d324fb4e0f req-889a2a45-5176-4641-b560-7ef7e7c46782 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:03.504752 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-b090bdc7-ab69-4d1e-80c5-14d324fb4e0f req-889a2a45-5176-4641-b560-7ef7e7c46782 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:03.520441 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-b090bdc7-ab69-4d1e-80c5-14d324fb4e0f req-889a2a45-5176-4641-b560-7ef7e7c46782 service nova] Creating event network-changed:ca679ea3-bdcd-4fab-8f2e-e0ba60316285 for instance 158b5aec-4d57-487e-8205-e4598e66020c on hv-cinder-81322 Jan 24 22:29:03.527859 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-b090bdc7-ab69-4d1e-80c5-14d324fb4e0f req-889a2a45-5176-4641-b560-7ef7e7c46782 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041600 Jan 24 22:29:03.529000 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 96/195] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:29:03.593783 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-85c26e0c-3612-4579-9447-6a367ce61063 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 14986 microversion: 2.1 time: 0.185154 Jan 24 22:29:03.598465 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 100/196] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:03 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 14986 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:03.839221 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-debaa28e-080d-474c-bb0b-be8fcc4961a6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:03.840470 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-debaa28e-080d-474c-bb0b-be8fcc4961a6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:03.847335 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-debaa28e-080d-474c-bb0b-be8fcc4961a6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:03.847774 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-debaa28e-080d-474c-bb0b-be8fcc4961a6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:03.848706 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-debaa28e-080d-474c-bb0b-be8fcc4961a6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:03.849338 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-debaa28e-080d-474c-bb0b-be8fcc4961a6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:04.019126 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-debaa28e-080d-474c-bb0b-be8fcc4961a6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:04.027547 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-debaa28e-080d-474c-bb0b-be8fcc4961a6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.193579 Jan 24 22:29:04.028324 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 97/197] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:03 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:04.166979 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1354b2d3-7677-414a-a321-b6847f6dbe24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:04.169129 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1354b2d3-7677-414a-a321-b6847f6dbe24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:04.180026 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1354b2d3-7677-414a-a321-b6847f6dbe24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:04.180457 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1354b2d3-7677-414a-a321-b6847f6dbe24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:04.181267 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1354b2d3-7677-414a-a321-b6847f6dbe24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:04.182259 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1354b2d3-7677-414a-a321-b6847f6dbe24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:04.247843 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ae5b1b98-5ac8-444b-956f-5b2e20396e9b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:04.248359 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ae5b1b98-5ac8-444b-956f-5b2e20396e9b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:04.259081 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ae5b1b98-5ac8-444b-956f-5b2e20396e9b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:04.259707 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ae5b1b98-5ac8-444b-956f-5b2e20396e9b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:04.260659 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ae5b1b98-5ac8-444b-956f-5b2e20396e9b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:04.261122 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ae5b1b98-5ac8-444b-956f-5b2e20396e9b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:04.368295 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1354b2d3-7677-414a-a321-b6847f6dbe24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 14 microversion: 2.20 time: 0.207010 Jan 24 22:29:04.369793 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 101/198] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:04 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 14 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:04.463775 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ae5b1b98-5ac8-444b-956f-5b2e20396e9b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:04.473570 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ae5b1b98-5ac8-444b-956f-5b2e20396e9b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 200 len: 1317 microversion: 2.1 time: 0.227824 Jan 24 22:29:04.473570 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 98/199] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:04 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:04.608424 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e9e15550-30b3-4ebb-b37f-dbe5efcf86a5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:04.609758 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e9e15550-30b3-4ebb-b37f-dbe5efcf86a5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:04.624458 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e9e15550-30b3-4ebb-b37f-dbe5efcf86a5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:04.625178 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e9e15550-30b3-4ebb-b37f-dbe5efcf86a5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:04.626151 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e9e15550-30b3-4ebb-b37f-dbe5efcf86a5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:04.627405 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e9e15550-30b3-4ebb-b37f-dbe5efcf86a5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:04.783449 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e9e15550-30b3-4ebb-b37f-dbe5efcf86a5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 17354 microversion: 2.1 time: 0.178329 Jan 24 22:29:04.783449 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 102/200] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:04 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 17354 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:05.046241 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ca48dedc-c617-4d29-8d64-e00e1bb1155a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:05.047184 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ca48dedc-c617-4d29-8d64-e00e1bb1155a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:05.056234 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ca48dedc-c617-4d29-8d64-e00e1bb1155a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:05.056966 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ca48dedc-c617-4d29-8d64-e00e1bb1155a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:05.058073 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ca48dedc-c617-4d29-8d64-e00e1bb1155a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:05.058606 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ca48dedc-c617-4d29-8d64-e00e1bb1155a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:05.213909 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ca48dedc-c617-4d29-8d64-e00e1bb1155a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:05.223050 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ca48dedc-c617-4d29-8d64-e00e1bb1155a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.181526 Jan 24 22:29:05.223637 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 99/201] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:05 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:05.381245 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2f469a26-f9e8-4885-acc7-6a363453c2da tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:05.382310 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2f469a26-f9e8-4885-acc7-6a363453c2da tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:05.392347 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2f469a26-f9e8-4885-acc7-6a363453c2da tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:05.392758 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2f469a26-f9e8-4885-acc7-6a363453c2da tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:05.393556 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2f469a26-f9e8-4885-acc7-6a363453c2da tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:05.394172 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2f469a26-f9e8-4885-acc7-6a363453c2da tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:05.489156 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a8a63659-7691-4994-8c14-3430f58ec634 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:05.489767 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a8a63659-7691-4994-8c14-3430f58ec634 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:05.497814 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a8a63659-7691-4994-8c14-3430f58ec634 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:05.498598 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a8a63659-7691-4994-8c14-3430f58ec634 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:05.501428 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a8a63659-7691-4994-8c14-3430f58ec634 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:05.504131 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a8a63659-7691-4994-8c14-3430f58ec634 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:05.508949 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2f469a26-f9e8-4885-acc7-6a363453c2da tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 14 microversion: 2.20 time: 0.131294 Jan 24 22:29:05.509855 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 103/202] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:05 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:05.651182 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a8a63659-7691-4994-8c14-3430f58ec634 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:05.658885 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a8a63659-7691-4994-8c14-3430f58ec634 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 200 len: 1317 microversion: 2.1 time: 0.173674 Jan 24 22:29:05.659459 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 100/203] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:05 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:05.794548 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-15d09795-e361-4a4b-a4b5-60bb7eb6340b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:05.795773 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-15d09795-e361-4a4b-a4b5-60bb7eb6340b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:05.807502 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-15d09795-e361-4a4b-a4b5-60bb7eb6340b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:05.808123 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-15d09795-e361-4a4b-a4b5-60bb7eb6340b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:05.809382 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-15d09795-e361-4a4b-a4b5-60bb7eb6340b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:05.810278 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-15d09795-e361-4a4b-a4b5-60bb7eb6340b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:05.825171 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e4ec1c27-a930-4699-ac02-144ba0f589e6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:05.825665 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e4ec1c27-a930-4699-ac02-144ba0f589e6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:05.831848 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e4ec1c27-a930-4699-ac02-144ba0f589e6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:05.832302 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e4ec1c27-a930-4699-ac02-144ba0f589e6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:05.833291 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e4ec1c27-a930-4699-ac02-144ba0f589e6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:05.833830 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e4ec1c27-a930-4699-ac02-144ba0f589e6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:05.860465 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e4ec1c27-a930-4699-ac02-144ba0f589e6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Going to try to terminate instance {{(pid=116466) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:29:05.929206 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-15d09795-e361-4a4b-a4b5-60bb7eb6340b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 17629 microversion: 2.1 time: 0.138893 Jan 24 22:29:05.930018 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 104/204] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:05 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 17629 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:05.966838 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e4ec1c27-a930-4699-ac02-144ba0f589e6 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "DELETE /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 204 len: 0 microversion: 2.1 time: 0.147999 Jan 24 22:29:05.967568 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 101/205] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:29:05 2022] DELETE /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:29:05.976702 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-be6df439-b7fc-448e-adf6-9c03eec66cc4 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:05.977524 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-be6df439-b7fc-448e-adf6-9c03eec66cc4 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:05.988919 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-be6df439-b7fc-448e-adf6-9c03eec66cc4 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:05.989419 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-be6df439-b7fc-448e-adf6-9c03eec66cc4 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:05.990206 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-be6df439-b7fc-448e-adf6-9c03eec66cc4 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:05.990634 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-be6df439-b7fc-448e-adf6-9c03eec66cc4 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:06.173501 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-be6df439-b7fc-448e-adf6-9c03eec66cc4 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:06.182093 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-be6df439-b7fc-448e-adf6-9c03eec66cc4 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1552 microversion: 2.1 time: 0.209718 Jan 24 22:29:06.182904 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 105/206] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:05 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1552 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:06.240269 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1de706a7-e3dc-4494-9ee3-dbdd3465cd99 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:06.242049 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-1de706a7-e3dc-4494-9ee3-dbdd3465cd99 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:06.252628 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1de706a7-e3dc-4494-9ee3-dbdd3465cd99 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:06.253692 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1de706a7-e3dc-4494-9ee3-dbdd3465cd99 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:06.254625 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1de706a7-e3dc-4494-9ee3-dbdd3465cd99 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:06.255045 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1de706a7-e3dc-4494-9ee3-dbdd3465cd99 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:06.416090 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-1de706a7-e3dc-4494-9ee3-dbdd3465cd99 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:06.424125 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-1de706a7-e3dc-4494-9ee3-dbdd3465cd99 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.188222 Jan 24 22:29:06.442864 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 102/207] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:06 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:06.519933 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-35f220f3-8b5c-4723-ac92-d9ab65784b20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:06.520847 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-35f220f3-8b5c-4723-ac92-d9ab65784b20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:06.527198 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-35f220f3-8b5c-4723-ac92-d9ab65784b20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:06.527646 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-35f220f3-8b5c-4723-ac92-d9ab65784b20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:06.528402 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-35f220f3-8b5c-4723-ac92-d9ab65784b20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:06.528826 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-35f220f3-8b5c-4723-ac92-d9ab65784b20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:06.641982 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-35f220f3-8b5c-4723-ac92-d9ab65784b20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 14 microversion: 2.20 time: 0.125488 Jan 24 22:29:06.642627 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 106/208] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:06 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:06.675372 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8241e9b6-3df1-43d4-89c1-46a6863d8251 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:06.675965 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8241e9b6-3df1-43d4-89c1-46a6863d8251 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:06.681935 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8241e9b6-3df1-43d4-89c1-46a6863d8251 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:06.682371 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8241e9b6-3df1-43d4-89c1-46a6863d8251 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:06.683143 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8241e9b6-3df1-43d4-89c1-46a6863d8251 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:06.683565 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8241e9b6-3df1-43d4-89c1-46a6863d8251 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:06.903320 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-8241e9b6-3df1-43d4-89c1-46a6863d8251 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:06.913056 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8241e9b6-3df1-43d4-89c1-46a6863d8251 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 200 len: 1317 microversion: 2.1 time: 0.241068 Jan 24 22:29:06.913651 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 103/209] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:06 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:06.942667 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-bc8e3799-75a2-48eb-82d6-cfed7db6f2fd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:06.943886 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-bc8e3799-75a2-48eb-82d6-cfed7db6f2fd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:06.952118 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bc8e3799-75a2-48eb-82d6-cfed7db6f2fd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:06.952441 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bc8e3799-75a2-48eb-82d6-cfed7db6f2fd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:06.953342 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bc8e3799-75a2-48eb-82d6-cfed7db6f2fd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:06.953940 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bc8e3799-75a2-48eb-82d6-cfed7db6f2fd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:07.083462 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-bc8e3799-75a2-48eb-82d6-cfed7db6f2fd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 19342 microversion: 2.1 time: 0.145303 Jan 24 22:29:07.086532 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 107/210] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:06 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 19342 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:07.208334 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a056e216-fcab-40d9-bc10-8aeb6f270811 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:07.208951 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a056e216-fcab-40d9-bc10-8aeb6f270811 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:07.223619 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a056e216-fcab-40d9-bc10-8aeb6f270811 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:07.224072 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a056e216-fcab-40d9-bc10-8aeb6f270811 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:07.224872 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a056e216-fcab-40d9-bc10-8aeb6f270811 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:07.225342 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a056e216-fcab-40d9-bc10-8aeb6f270811 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:07.379102 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a056e216-fcab-40d9-bc10-8aeb6f270811 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:07.387552 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a056e216-fcab-40d9-bc10-8aeb6f270811 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1552 microversion: 2.1 time: 0.183935 Jan 24 22:29:07.388113 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 104/211] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:07 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1552 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:07.460220 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2a939f6d-3845-41a7-9978-24a6b0cecaeb tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:07.461277 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2a939f6d-3845-41a7-9978-24a6b0cecaeb tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:07.468212 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2a939f6d-3845-41a7-9978-24a6b0cecaeb tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:07.468661 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2a939f6d-3845-41a7-9978-24a6b0cecaeb tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:07.469466 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2a939f6d-3845-41a7-9978-24a6b0cecaeb tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:07.470119 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2a939f6d-3845-41a7-9978-24a6b0cecaeb tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:07.620853 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2a939f6d-3845-41a7-9978-24a6b0cecaeb tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:07.629164 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2a939f6d-3845-41a7-9978-24a6b0cecaeb tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.173117 Jan 24 22:29:07.635239 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 108/212] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:07 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:07.654039 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-edf38c55-02c2-457d-bb0f-5263b709a8f1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:07.665620 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-edf38c55-02c2-457d-bb0f-5263b709a8f1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:07.678637 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-edf38c55-02c2-457d-bb0f-5263b709a8f1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:07.680833 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-edf38c55-02c2-457d-bb0f-5263b709a8f1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:07.681938 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-edf38c55-02c2-457d-bb0f-5263b709a8f1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:07.685384 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-edf38c55-02c2-457d-bb0f-5263b709a8f1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:07.838465 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-edf38c55-02c2-457d-bb0f-5263b709a8f1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 14 microversion: 2.20 time: 0.188927 Jan 24 22:29:07.839497 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 105/213] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:07 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 14 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:07.930649 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-52ae7eac-866c-4e27-a60f-0d36b9f5b2e4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:07.931342 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-52ae7eac-866c-4e27-a60f-0d36b9f5b2e4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:07.939106 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-52ae7eac-866c-4e27-a60f-0d36b9f5b2e4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:07.939752 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-52ae7eac-866c-4e27-a60f-0d36b9f5b2e4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:07.941076 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-52ae7eac-866c-4e27-a60f-0d36b9f5b2e4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:07.941822 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-52ae7eac-866c-4e27-a60f-0d36b9f5b2e4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:08.096158 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-91511d45-be16-401b-954d-8ee963eedeaf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:08.097557 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-91511d45-be16-401b-954d-8ee963eedeaf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:08.109733 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-52ae7eac-866c-4e27-a60f-0d36b9f5b2e4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:08.111015 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-91511d45-be16-401b-954d-8ee963eedeaf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:08.112558 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-91511d45-be16-401b-954d-8ee963eedeaf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:08.113475 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-91511d45-be16-401b-954d-8ee963eedeaf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:08.113991 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-91511d45-be16-401b-954d-8ee963eedeaf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:08.119453 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-52ae7eac-866c-4e27-a60f-0d36b9f5b2e4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 200 len: 1317 microversion: 2.1 time: 0.193373 Jan 24 22:29:08.122022 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 109/214] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:07 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:08.301868 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-91511d45-be16-401b-954d-8ee963eedeaf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 20996 microversion: 2.1 time: 0.209615 Jan 24 22:29:08.302497 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 106/215] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:08 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 20996 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:08.404622 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3872b659-96b8-4538-bf4e-f6d8e56af773 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:08.405232 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-3872b659-96b8-4538-bf4e-f6d8e56af773 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:08.411827 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3872b659-96b8-4538-bf4e-f6d8e56af773 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:08.412510 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3872b659-96b8-4538-bf4e-f6d8e56af773 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:08.413569 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3872b659-96b8-4538-bf4e-f6d8e56af773 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:08.414360 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3872b659-96b8-4538-bf4e-f6d8e56af773 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:08.549302 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3872b659-96b8-4538-bf4e-f6d8e56af773 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:08.557502 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-3872b659-96b8-4538-bf4e-f6d8e56af773 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1552 microversion: 2.1 time: 0.156419 Jan 24 22:29:08.558067 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 110/216] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:08 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:08.653460 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-781ebddb-bfba-4f4a-9e54-8a4283d03063 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:08.654802 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-781ebddb-bfba-4f4a-9e54-8a4283d03063 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:08.664138 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-781ebddb-bfba-4f4a-9e54-8a4283d03063 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:08.664910 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-781ebddb-bfba-4f4a-9e54-8a4283d03063 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:08.666030 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-781ebddb-bfba-4f4a-9e54-8a4283d03063 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:08.666858 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-781ebddb-bfba-4f4a-9e54-8a4283d03063 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:08.849935 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-75360fdf-70ba-44c6-a83f-f4f28d022a2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:08.851272 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-75360fdf-70ba-44c6-a83f-f4f28d022a2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:08.857290 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-75360fdf-70ba-44c6-a83f-f4f28d022a2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:08.857731 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-75360fdf-70ba-44c6-a83f-f4f28d022a2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:08.858501 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-75360fdf-70ba-44c6-a83f-f4f28d022a2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:08.858924 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-75360fdf-70ba-44c6-a83f-f4f28d022a2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:08.892404 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-781ebddb-bfba-4f4a-9e54-8a4283d03063 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:08.905727 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-781ebddb-bfba-4f4a-9e54-8a4283d03063 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.256933 Jan 24 22:29:08.907046 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 107/217] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:08 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:09.057855 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-75360fdf-70ba-44c6-a83f-f4f28d022a2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 14 microversion: 2.20 time: 0.211576 Jan 24 22:29:09.058755 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 111/218] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:08 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 14 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:09.135606 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6b9874b4-d947-4cd3-9307-c77726236f3e tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:09.136238 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6b9874b4-d947-4cd3-9307-c77726236f3e tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:09.143875 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6b9874b4-d947-4cd3-9307-c77726236f3e tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:09.144328 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6b9874b4-d947-4cd3-9307-c77726236f3e tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:09.145147 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6b9874b4-d947-4cd3-9307-c77726236f3e tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:09.145582 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6b9874b4-d947-4cd3-9307-c77726236f3e tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:09.313930 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1c999a52-b968-428e-aa99-fa25e07311a2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:09.314933 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1c999a52-b968-428e-aa99-fa25e07311a2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:09.324239 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1c999a52-b968-428e-aa99-fa25e07311a2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:09.324680 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1c999a52-b968-428e-aa99-fa25e07311a2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:09.327106 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1c999a52-b968-428e-aa99-fa25e07311a2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:09.327871 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1c999a52-b968-428e-aa99-fa25e07311a2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:09.331930 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-6b9874b4-d947-4cd3-9307-c77726236f3e tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:09.348707 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6b9874b4-d947-4cd3-9307-c77726236f3e tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 200 len: 1317 microversion: 2.1 time: 0.215843 Jan 24 22:29:09.358874 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 108/219] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:09 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:09.528778 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1c999a52-b968-428e-aa99-fa25e07311a2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 22167 microversion: 2.1 time: 0.218267 Jan 24 22:29:09.533072 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 112/220] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:09 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 22167 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:29:09.574434 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-f899d8aa-07b5-4638-b8c0-27bda8567f43 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:09.575038 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-f899d8aa-07b5-4638-b8c0-27bda8567f43 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:09.584314 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f899d8aa-07b5-4638-b8c0-27bda8567f43 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:09.584923 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f899d8aa-07b5-4638-b8c0-27bda8567f43 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:09.586609 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f899d8aa-07b5-4638-b8c0-27bda8567f43 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:09.587298 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f899d8aa-07b5-4638-b8c0-27bda8567f43 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:09.812822 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-f899d8aa-07b5-4638-b8c0-27bda8567f43 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:09.841907 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-f899d8aa-07b5-4638-b8c0-27bda8567f43 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1552 microversion: 2.1 time: 0.270505 Jan 24 22:29:09.842821 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 109/221] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:09 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1552 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:09.923860 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-5572cf28-41da-4e83-b720-cb0b1c1d4738 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:09.924550 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-5572cf28-41da-4e83-b720-cb0b1c1d4738 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:09.931744 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5572cf28-41da-4e83-b720-cb0b1c1d4738 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:09.932212 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5572cf28-41da-4e83-b720-cb0b1c1d4738 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:09.932979 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5572cf28-41da-4e83-b720-cb0b1c1d4738 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:09.933439 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5572cf28-41da-4e83-b720-cb0b1c1d4738 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:10.073201 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-237dd365-6dd5-4f97-b648-6da7b66830ea tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:10.074180 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-237dd365-6dd5-4f97-b648-6da7b66830ea tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:10.080825 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-237dd365-6dd5-4f97-b648-6da7b66830ea tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:10.081303 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-237dd365-6dd5-4f97-b648-6da7b66830ea tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:10.082087 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-237dd365-6dd5-4f97-b648-6da7b66830ea tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:10.082517 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-237dd365-6dd5-4f97-b648-6da7b66830ea tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:10.161438 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5572cf28-41da-4e83-b720-cb0b1c1d4738 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:10.169208 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-5572cf28-41da-4e83-b720-cb0b1c1d4738 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.249166 Jan 24 22:29:10.171461 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 113/222] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:09 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:10.176256 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-5117dad3-9b49-45b6-9974-cf04c9554233 req-b9c86a55-814d-4466-96b1-2064a2c76653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33400f7e-6413-4b0d-8062-8c4befff1b88", "name": "network-vif-deleted", "tag": "a2470f65-0c4d-4ecd-a4b6-9d25e27a0c99"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:10.178139 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:29:10.178139 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:29:10.185324 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-5117dad3-9b49-45b6-9974-cf04c9554233 req-b9c86a55-814d-4466-96b1-2064a2c76653 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:10.185758 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-5117dad3-9b49-45b6-9974-cf04c9554233 req-b9c86a55-814d-4466-96b1-2064a2c76653 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:10.209239 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-5117dad3-9b49-45b6-9974-cf04c9554233 req-b9c86a55-814d-4466-96b1-2064a2c76653 service nova] Creating event network-vif-deleted:a2470f65-0c4d-4ecd-a4b6-9d25e27a0c99 for instance 33400f7e-6413-4b0d-8062-8c4befff1b88 on hv-cinder-81322 Jan 24 22:29:10.217648 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-5117dad3-9b49-45b6-9974-cf04c9554233 req-b9c86a55-814d-4466-96b1-2064a2c76653 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044717 Jan 24 22:29:10.220327 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 114/223] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:10.229335 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-81288a66-6431-4f1f-af29-52a9f6fac8c7 req-1639f428-3383-413e-8061-e42c3133c9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158b5aec-4d57-487e-8205-e4598e66020c", "name": "network-vif-plugged", "status": "completed", "tag": "ca679ea3-bdcd-4fab-8f2e-e0ba60316285"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:10.230972 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-237dd365-6dd5-4f97-b648-6da7b66830ea tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 14 microversion: 2.20 time: 0.165046 Jan 24 22:29:10.231699 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 110/224] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:10 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:10.234516 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:29:10.234516 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:29:10.244185 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-81288a66-6431-4f1f-af29-52a9f6fac8c7 req-1639f428-3383-413e-8061-e42c3133c9aa service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:10.244709 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-81288a66-6431-4f1f-af29-52a9f6fac8c7 req-1639f428-3383-413e-8061-e42c3133c9aa service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:10.259720 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-81288a66-6431-4f1f-af29-52a9f6fac8c7 req-1639f428-3383-413e-8061-e42c3133c9aa service nova] Creating event network-vif-plugged:ca679ea3-bdcd-4fab-8f2e-e0ba60316285 for instance 158b5aec-4d57-487e-8205-e4598e66020c on hv-cinder-81322 Jan 24 22:29:10.266382 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-81288a66-6431-4f1f-af29-52a9f6fac8c7 req-1639f428-3383-413e-8061-e42c3133c9aa service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043644 Jan 24 22:29:10.266997 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 115/225] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:10.375477 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-84793dc5-4c62-4dd0-8d8f-49217ba82bd2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:10.376554 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-84793dc5-4c62-4dd0-8d8f-49217ba82bd2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:10.384638 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-84793dc5-4c62-4dd0-8d8f-49217ba82bd2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:10.385362 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-84793dc5-4c62-4dd0-8d8f-49217ba82bd2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:10.387345 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-84793dc5-4c62-4dd0-8d8f-49217ba82bd2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:10.388084 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-84793dc5-4c62-4dd0-8d8f-49217ba82bd2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:10.545610 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2c175ba3-a4b1-4f7d-b746-23b9e1ad9d61 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:10.547127 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2c175ba3-a4b1-4f7d-b746-23b9e1ad9d61 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:10.554375 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2c175ba3-a4b1-4f7d-b746-23b9e1ad9d61 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:10.555165 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2c175ba3-a4b1-4f7d-b746-23b9e1ad9d61 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:10.556294 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2c175ba3-a4b1-4f7d-b746-23b9e1ad9d61 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:10.557157 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2c175ba3-a4b1-4f7d-b746-23b9e1ad9d61 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:10.558507 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-84793dc5-4c62-4dd0-8d8f-49217ba82bd2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:10.567768 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-84793dc5-4c62-4dd0-8d8f-49217ba82bd2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 200 len: 1317 microversion: 2.1 time: 0.196900 Jan 24 22:29:10.576205 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 111/226] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:10 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:10.859716 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-aefdfa07-f220-47d8-b9c6-586cc09a9d2f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:10.860350 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-aefdfa07-f220-47d8-b9c6-586cc09a9d2f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:10.867580 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-aefdfa07-f220-47d8-b9c6-586cc09a9d2f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:10.868345 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-aefdfa07-f220-47d8-b9c6-586cc09a9d2f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:10.869377 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-aefdfa07-f220-47d8-b9c6-586cc09a9d2f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:10.870032 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-aefdfa07-f220-47d8-b9c6-586cc09a9d2f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:10.906544 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-aefdfa07-f220-47d8-b9c6-586cc09a9d2f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:10.907115 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-aefdfa07-f220-47d8-b9c6-586cc09a9d2f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:10.907785 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.objects.instance [None req-aefdfa07-f220-47d8-b9c6-586cc09a9d2f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lazy-loading 'fault' on Instance uuid 33400f7e-6413-4b0d-8062-8c4befff1b88 {{(pid=116466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:29:10.969072 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-aefdfa07-f220-47d8-b9c6-586cc09a9d2f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caac87d558354fa188d16f131612030a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ba1e1256864514ab790aa9db823338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:10.979105 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-aefdfa07-f220-47d8-b9c6-586cc09a9d2f tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 200 len: 1351 microversion: 2.1 time: 0.122981 Jan 24 22:29:10.979847 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 112/227] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:10 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 1351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:11.107143 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2c175ba3-a4b1-4f7d-b746-23b9e1ad9d61 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 23801 microversion: 2.1 time: 0.568773 Jan 24 22:29:11.107953 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 116/228] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:10 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 23801 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:11.187425 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-fb8af834-8b37-42c5-9f52-544cc8d8f675 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:11.188135 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-fb8af834-8b37-42c5-9f52-544cc8d8f675 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:11.194978 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fb8af834-8b37-42c5-9f52-544cc8d8f675 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:11.195489 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fb8af834-8b37-42c5-9f52-544cc8d8f675 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:11.196260 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fb8af834-8b37-42c5-9f52-544cc8d8f675 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:11.196685 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fb8af834-8b37-42c5-9f52-544cc8d8f675 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:11.242619 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a617b585-4b11-4508-8a6a-9035a030dbf2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:11.243630 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a617b585-4b11-4508-8a6a-9035a030dbf2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:11.251385 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a617b585-4b11-4508-8a6a-9035a030dbf2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:11.252061 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a617b585-4b11-4508-8a6a-9035a030dbf2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:11.253020 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a617b585-4b11-4508-8a6a-9035a030dbf2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:11.253853 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a617b585-4b11-4508-8a6a-9035a030dbf2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:11.337748 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-fb8af834-8b37-42c5-9f52-544cc8d8f675 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:11.345434 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-fb8af834-8b37-42c5-9f52-544cc8d8f675 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.161704 Jan 24 22:29:11.346001 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 113/229] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:11 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:11.387219 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a617b585-4b11-4508-8a6a-9035a030dbf2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 14 microversion: 2.20 time: 0.148611 Jan 24 22:29:11.387851 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 117/230] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:11 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:11.593260 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7b53dc46-d33d-4bd4-823d-d0672c53afb6 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:11.594228 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7b53dc46-d33d-4bd4-823d-d0672c53afb6 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:11.600759 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7b53dc46-d33d-4bd4-823d-d0672c53afb6 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:11.601288 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7b53dc46-d33d-4bd4-823d-d0672c53afb6 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:11.602137 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7b53dc46-d33d-4bd4-823d-d0672c53afb6 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:11.602799 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7b53dc46-d33d-4bd4-823d-d0672c53afb6 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:11.748016 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7b53dc46-d33d-4bd4-823d-d0672c53afb6 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:11.756100 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7b53dc46-d33d-4bd4-823d-d0672c53afb6 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 200 len: 1317 microversion: 2.1 time: 0.168030 Jan 24 22:29:11.756911 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 114/231] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:11 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:11.997029 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-450e1bf8-871b-408d-bb4d-246e8ed82b7b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:11.997651 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-450e1bf8-871b-408d-bb4d-246e8ed82b7b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:12.004554 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-450e1bf8-871b-408d-bb4d-246e8ed82b7b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:12.005023 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-450e1bf8-871b-408d-bb4d-246e8ed82b7b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:12.005802 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-450e1bf8-871b-408d-bb4d-246e8ed82b7b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:12.006240 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-450e1bf8-871b-408d-bb4d-246e8ed82b7b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:12.020889 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-450e1bf8-871b-408d-bb4d-246e8ed82b7b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] HTTP exception thrown: Instance 33400f7e-6413-4b0d-8062-8c4befff1b88 could not be found. Jan 24 22:29:12.021622 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-450e1bf8-871b-408d-bb4d-246e8ed82b7b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Returning 404 to user: Instance 33400f7e-6413-4b0d-8062-8c4befff1b88 could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:29:12.022487 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-450e1bf8-871b-408d-bb4d-246e8ed82b7b tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 404 len: 111 microversion: 2.1 time: 0.030255 Jan 24 22:29:12.023250 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 118/232] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:11 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:29:12.127396 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-00306b9a-ef67-49ac-8b45-427a73f5a74d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:12.128956 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2f862624-4fd8-40da-9b89-f4581ffd3f58 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:12.130977 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-00306b9a-ef67-49ac-8b45-427a73f5a74d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:12.132258 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2f862624-4fd8-40da-9b89-f4581ffd3f58 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:12.145495 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2f862624-4fd8-40da-9b89-f4581ffd3f58 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:12.145977 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2f862624-4fd8-40da-9b89-f4581ffd3f58 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:12.146216 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-00306b9a-ef67-49ac-8b45-427a73f5a74d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:12.146687 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-00306b9a-ef67-49ac-8b45-427a73f5a74d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:12.148128 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-00306b9a-ef67-49ac-8b45-427a73f5a74d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:12.149212 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2f862624-4fd8-40da-9b89-f4581ffd3f58 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:12.149709 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2f862624-4fd8-40da-9b89-f4581ffd3f58 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:12.151023 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-00306b9a-ef67-49ac-8b45-427a73f5a74d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:12.175539 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-00306b9a-ef67-49ac-8b45-427a73f5a74d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] HTTP exception thrown: Instance 33400f7e-6413-4b0d-8062-8c4befff1b88 could not be found. Jan 24 22:29:12.176385 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-00306b9a-ef67-49ac-8b45-427a73f5a74d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Returning 404 to user: Instance 33400f7e-6413-4b0d-8062-8c4befff1b88 could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:29:12.177092 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-00306b9a-ef67-49ac-8b45-427a73f5a74d tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.054014 Jan 24 22:29:12.181757 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 119/233] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:29:12 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88/os-volume_attachments => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:29:12.362029 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1c8a6ece-f1e3-442d-a074-c7691905350e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:12.362644 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1c8a6ece-f1e3-442d-a074-c7691905350e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:12.369411 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1c8a6ece-f1e3-442d-a074-c7691905350e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:12.369837 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1c8a6ece-f1e3-442d-a074-c7691905350e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:12.370633 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1c8a6ece-f1e3-442d-a074-c7691905350e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:12.371065 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1c8a6ece-f1e3-442d-a074-c7691905350e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:12.437698 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2f862624-4fd8-40da-9b89-f4581ffd3f58 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 24227 microversion: 2.1 time: 0.321509 Jan 24 22:29:12.442016 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 115/234] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:12 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 24227 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:12.443791 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3dc56ed2-0ec9-48ec-84ee-1f89354eabd1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:12.444813 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3dc56ed2-0ec9-48ec-84ee-1f89354eabd1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:12.452661 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3dc56ed2-0ec9-48ec-84ee-1f89354eabd1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:12.453134 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3dc56ed2-0ec9-48ec-84ee-1f89354eabd1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:12.453965 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3dc56ed2-0ec9-48ec-84ee-1f89354eabd1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:12.454388 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3dc56ed2-0ec9-48ec-84ee-1f89354eabd1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:12.512009 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1c8a6ece-f1e3-442d-a074-c7691905350e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:12.519719 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1c8a6ece-f1e3-442d-a074-c7691905350e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.161393 Jan 24 22:29:12.520283 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 120/235] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:12 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:12.603219 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3dc56ed2-0ec9-48ec-84ee-1f89354eabd1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 14 microversion: 2.20 time: 0.162969 Jan 24 22:29:12.603862 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 116/236] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:12 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:12.783076 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e6c7bed0-2cd3-47f7-965d-a98adda00393 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:12.783910 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e6c7bed0-2cd3-47f7-965d-a98adda00393 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:12.794651 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e6c7bed0-2cd3-47f7-965d-a98adda00393 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:12.795439 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e6c7bed0-2cd3-47f7-965d-a98adda00393 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:12.796620 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e6c7bed0-2cd3-47f7-965d-a98adda00393 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:12.797490 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e6c7bed0-2cd3-47f7-965d-a98adda00393 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:12.938220 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e6c7bed0-2cd3-47f7-965d-a98adda00393 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:12.946188 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e6c7bed0-2cd3-47f7-965d-a98adda00393 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 200 len: 1507 microversion: 2.1 time: 0.169641 Jan 24 22:29:12.946804 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 121/237] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:12 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:12.963178 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ca9531d9-b2a5-404a-b861-488cddfb3f79 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21eda49d-3c31-45e7-ba92-b7c0a2bba992"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:12.964323 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ca9531d9-b2a5-404a-b861-488cddfb3f79 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:12.972107 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ca9531d9-b2a5-404a-b861-488cddfb3f79 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:12.972558 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ca9531d9-b2a5-404a-b861-488cddfb3f79 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:12.973413 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ca9531d9-b2a5-404a-b861-488cddfb3f79 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:12.973845 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ca9531d9-b2a5-404a-b861-488cddfb3f79 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:13.054218 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-ca9531d9-b2a5-404a-b861-488cddfb3f79 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] HTTP exception thrown: Invalid volume: volume 21eda49d-3c31-45e7-ba92-b7c0a2bba992 is already attached to instances: 179be558-5543-42db-b299-8115c58cf1e5 Jan 24 22:29:13.055555 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ca9531d9-b2a5-404a-b861-488cddfb3f79 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Returning 400 to user: Invalid volume: volume 21eda49d-3c31-45e7-ba92-b7c0a2bba992 is already attached to instances: 179be558-5543-42db-b299-8115c58cf1e5 {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:29:13.056380 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ca9531d9-b2a5-404a-b861-488cddfb3f79 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "POST /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097824 Jan 24 22:29:13.056896 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 117/238] 10.222.0.84 () {60 vars in 1322 bytes} [Mon Jan 24 22:29:12 2022] POST /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 24 22:29:13.114477 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-18cf11ce-ec82-415d-9ca6-ef01c8c65755 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:13.114961 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-18cf11ce-ec82-415d-9ca6-ef01c8c65755 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:13.121343 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-18cf11ce-ec82-415d-9ca6-ef01c8c65755 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:13.121796 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-18cf11ce-ec82-415d-9ca6-ef01c8c65755 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:13.122539 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-18cf11ce-ec82-415d-9ca6-ef01c8c65755 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:13.122962 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-18cf11ce-ec82-415d-9ca6-ef01c8c65755 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:13.404255 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-18cf11ce-ec82-415d-9ca6-ef01c8c65755 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lazy-loading 'services' on Instance uuid 179be558-5543-42db-b299-8115c58cf1e5 {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:29:13.450159 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7824e301-aa9d-43f8-8fdc-8d41cde2d405 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:13.452030 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7824e301-aa9d-43f8-8fdc-8d41cde2d405 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:13.461337 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7824e301-aa9d-43f8-8fdc-8d41cde2d405 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:13.462225 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7824e301-aa9d-43f8-8fdc-8d41cde2d405 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:13.463266 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7824e301-aa9d-43f8-8fdc-8d41cde2d405 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:13.463845 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7824e301-aa9d-43f8-8fdc-8d41cde2d405 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:13.898920 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-18cf11ce-ec82-415d-9ca6-ef01c8c65755 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "DELETE /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5/os-volume_attachments/21eda49d-3c31-45e7-ba92-b7c0a2bba992" status: 202 len: 0 microversion: 2.1 time: 0.787999 Jan 24 22:29:13.899577 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 122/239] 10.222.0.84 () {58 vars in 1415 bytes} [Mon Jan 24 22:29:13 2022] DELETE /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5/os-volume_attachments/21eda49d-3c31-45e7-ba92-b7c0a2bba992 => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:13.908406 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-598ef561-1480-4cd9-a383-277bd16f196e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:13.909155 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-598ef561-1480-4cd9-a383-277bd16f196e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:13.915408 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-598ef561-1480-4cd9-a383-277bd16f196e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:13.916084 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-598ef561-1480-4cd9-a383-277bd16f196e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:13.917089 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-598ef561-1480-4cd9-a383-277bd16f196e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:13.918333 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-598ef561-1480-4cd9-a383-277bd16f196e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:14.062555 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-598ef561-1480-4cd9-a383-277bd16f196e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:14.070026 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-598ef561-1480-4cd9-a383-277bd16f196e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.165573 Jan 24 22:29:14.070656 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 123/240] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:13 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:14.075341 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-81705dbc-38be-4143-aa03-1ebac4cfe9fb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:14.076314 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-81705dbc-38be-4143-aa03-1ebac4cfe9fb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:14.081911 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-81705dbc-38be-4143-aa03-1ebac4cfe9fb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:14.082353 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-81705dbc-38be-4143-aa03-1ebac4cfe9fb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:14.083120 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-81705dbc-38be-4143-aa03-1ebac4cfe9fb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:14.083547 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-81705dbc-38be-4143-aa03-1ebac4cfe9fb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:15.838293 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7824e301-aa9d-43f8-8fdc-8d41cde2d405 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 26539 microversion: 2.1 time: 2.391903 Jan 24 22:29:15.839314 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 118/241] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:13 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 26539 bytes in 2394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:15.845601 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-cbd8d22b-9d4b-4c77-8eb5-5b6c5e9e4c62 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:15.846784 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-cbd8d22b-9d4b-4c77-8eb5-5b6c5e9e4c62 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:15.855372 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cbd8d22b-9d4b-4c77-8eb5-5b6c5e9e4c62 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:15.855803 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cbd8d22b-9d4b-4c77-8eb5-5b6c5e9e4c62 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:15.856604 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cbd8d22b-9d4b-4c77-8eb5-5b6c5e9e4c62 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:15.857110 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cbd8d22b-9d4b-4c77-8eb5-5b6c5e9e4c62 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:15.888486 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-cbd8d22b-9d4b-4c77-8eb5-5b6c5e9e4c62 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047574 Jan 24 22:29:15.889045 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 119/242] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:29:15 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:15.894862 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-62c4fc0d-9995-4418-9f65-df82d1bec7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:15.895461 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-62c4fc0d-9995-4418-9f65-df82d1bec7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:15.901923 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-62c4fc0d-9995-4418-9f65-df82d1bec7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:15.902370 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-62c4fc0d-9995-4418-9f65-df82d1bec7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:15.903148 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-62c4fc0d-9995-4418-9f65-df82d1bec7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:15.903609 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-62c4fc0d-9995-4418-9f65-df82d1bec7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:15.909019 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-81705dbc-38be-4143-aa03-1ebac4cfe9fb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 14 microversion: 2.20 time: 1.836567 Jan 24 22:29:15.913135 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 124/243] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:14 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 14 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:16.035911 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-62c4fc0d-9995-4418-9f65-df82d1bec7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:16.043708 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-62c4fc0d-9995-4418-9f65-df82d1bec7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.153691 Jan 24 22:29:16.044271 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 120/244] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:15 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:16.853287 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-05f737ea-60c7-4d6e-b0fb-dabb59445a67 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:16.854341 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-05f737ea-60c7-4d6e-b0fb-dabb59445a67 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:16.861336 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-05f737ea-60c7-4d6e-b0fb-dabb59445a67 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:16.861717 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-05f737ea-60c7-4d6e-b0fb-dabb59445a67 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:16.862491 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-05f737ea-60c7-4d6e-b0fb-dabb59445a67 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:16.862927 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-05f737ea-60c7-4d6e-b0fb-dabb59445a67 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:16.901660 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2372dc87-1aa1-4876-b913-f37262f8830c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:16.903235 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2372dc87-1aa1-4876-b913-f37262f8830c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:16.909991 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2372dc87-1aa1-4876-b913-f37262f8830c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:16.910442 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2372dc87-1aa1-4876-b913-f37262f8830c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:16.911215 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2372dc87-1aa1-4876-b913-f37262f8830c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:16.911643 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2372dc87-1aa1-4876-b913-f37262f8830c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:16.940807 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2372dc87-1aa1-4876-b913-f37262f8830c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042986 Jan 24 22:29:16.941389 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 121/245] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:29:16 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:16.945971 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ba3e8adf-947b-4598-9f28-ea2a6684be4f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:16.946984 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ba3e8adf-947b-4598-9f28-ea2a6684be4f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:16.952626 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ba3e8adf-947b-4598-9f28-ea2a6684be4f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:16.953134 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ba3e8adf-947b-4598-9f28-ea2a6684be4f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:16.953911 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ba3e8adf-947b-4598-9f28-ea2a6684be4f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:16.954340 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ba3e8adf-947b-4598-9f28-ea2a6684be4f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:17.000781 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-05f737ea-60c7-4d6e-b0fb-dabb59445a67 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 26992 microversion: 2.1 time: 0.152709 Jan 24 22:29:17.001459 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 125/246] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:16 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 26992 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:17.060967 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-62ce6fdf-19f0-4a02-983b-85b97dd1b30f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:17.061685 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-62ce6fdf-19f0-4a02-983b-85b97dd1b30f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:17.068845 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-62ce6fdf-19f0-4a02-983b-85b97dd1b30f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:17.069331 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-62ce6fdf-19f0-4a02-983b-85b97dd1b30f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:17.070195 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-62ce6fdf-19f0-4a02-983b-85b97dd1b30f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:17.070629 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-62ce6fdf-19f0-4a02-983b-85b97dd1b30f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:17.081679 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ba3e8adf-947b-4598-9f28-ea2a6684be4f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 14 microversion: 2.20 time: 0.137954 Jan 24 22:29:17.082637 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 122/247] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:16 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:17.226508 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-62ce6fdf-19f0-4a02-983b-85b97dd1b30f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:17.236131 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-62ce6fdf-19f0-4a02-983b-85b97dd1b30f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.179714 Jan 24 22:29:17.248811 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 126/248] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:17 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:17.700211 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-137e4b71-2cb8-466f-9989-8e3ff0e875b2 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:17.700742 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-137e4b71-2cb8-466f-9989-8e3ff0e875b2 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:17.709034 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-137e4b71-2cb8-466f-9989-8e3ff0e875b2 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:17.710075 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-137e4b71-2cb8-466f-9989-8e3ff0e875b2 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:17.710936 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-137e4b71-2cb8-466f-9989-8e3ff0e875b2 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:17.711405 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-137e4b71-2cb8-466f-9989-8e3ff0e875b2 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:17.727948 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-137e4b71-2cb8-466f-9989-8e3ff0e875b2 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] HTTP exception thrown: Instance 33400f7e-6413-4b0d-8062-8c4befff1b88 could not be found. Jan 24 22:29:17.728733 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-137e4b71-2cb8-466f-9989-8e3ff0e875b2 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Returning 404 to user: Instance 33400f7e-6413-4b0d-8062-8c4befff1b88 could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:29:17.729860 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-137e4b71-2cb8-466f-9989-8e3ff0e875b2 tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "DELETE /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 404 len: 111 microversion: 2.1 time: 0.036691 Jan 24 22:29:17.730785 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 123/249] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:29:17 2022] DELETE /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:29:17.739114 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9a0137a3-0c53-4bea-87da-b9e84608f64a tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:17.739898 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9a0137a3-0c53-4bea-87da-b9e84608f64a tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] [instance: 33400f7e-6413-4b0d-8062-8c4befff1b88] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:17.746402 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9a0137a3-0c53-4bea-87da-b9e84608f64a tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:17.746899 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9a0137a3-0c53-4bea-87da-b9e84608f64a tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:17.747784 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9a0137a3-0c53-4bea-87da-b9e84608f64a tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:17.748375 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9a0137a3-0c53-4bea-87da-b9e84608f64a tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:17.763037 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-9a0137a3-0c53-4bea-87da-b9e84608f64a tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] HTTP exception thrown: Instance 33400f7e-6413-4b0d-8062-8c4befff1b88 could not be found. Jan 24 22:29:17.763636 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9a0137a3-0c53-4bea-87da-b9e84608f64a tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] Returning 404 to user: Instance 33400f7e-6413-4b0d-8062-8c4befff1b88 could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:29:17.764465 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9a0137a3-0c53-4bea-87da-b9e84608f64a tempest-DeleteServersTestJSON-655684541 tempest-DeleteServersTestJSON-655684541-project] 10.222.0.84 "GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88" status: 404 len: 111 microversion: 2.1 time: 0.029624 Jan 24 22:29:17.765885 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 127/250] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:17 2022] GET /compute/v2.1/servers/33400f7e-6413-4b0d-8062-8c4befff1b88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:29:17.953078 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-bdf6691b-67a1-4c63-a008-d0fb60cb552d tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:17.954106 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-bdf6691b-67a1-4c63-a008-d0fb60cb552d tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:17.960600 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bdf6691b-67a1-4c63-a008-d0fb60cb552d tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:17.961076 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bdf6691b-67a1-4c63-a008-d0fb60cb552d tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:17.962669 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bdf6691b-67a1-4c63-a008-d0fb60cb552d tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:17.963266 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bdf6691b-67a1-4c63-a008-d0fb60cb552d tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:18.001155 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-bdf6691b-67a1-4c63-a008-d0fb60cb552d tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052144 Jan 24 22:29:18.001999 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 124/251] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:29:17 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 22:29:18.026531 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-22490b71-aaa6-454d-bb4f-5c115bbefe38 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:18.027660 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-22490b71-aaa6-454d-bb4f-5c115bbefe38 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:18.034483 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-22490b71-aaa6-454d-bb4f-5c115bbefe38 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:18.034869 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-22490b71-aaa6-454d-bb4f-5c115bbefe38 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:18.035769 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-22490b71-aaa6-454d-bb4f-5c115bbefe38 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:18.036270 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-22490b71-aaa6-454d-bb4f-5c115bbefe38 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:18.093187 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e3f84bd0-264a-42f5-b3c6-66c839b33d6e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:18.094093 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e3f84bd0-264a-42f5-b3c6-66c839b33d6e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:18.105734 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3f84bd0-264a-42f5-b3c6-66c839b33d6e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:18.106199 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3f84bd0-264a-42f5-b3c6-66c839b33d6e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:18.107339 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3f84bd0-264a-42f5-b3c6-66c839b33d6e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:18.107922 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3f84bd0-264a-42f5-b3c6-66c839b33d6e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:18.221153 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-22490b71-aaa6-454d-bb4f-5c115bbefe38 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 27546 microversion: 2.1 time: 0.204195 Jan 24 22:29:18.221863 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 128/252] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:18 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 27546 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:18.230364 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-db5f1e28-0967-4d5c-9431-98054f45bdbb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-687952926", "imageRef": "4fe12948-6887-4759-900b-f3ee39409e75", "flavorRef": "452", "networks": [{"uuid": "e8ede52f-f77b-4695-9cf8-08051f1c017e"}]}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:18.284554 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.network.neutron [None req-db5f1e28-0967-4d5c-9431-98054f45bdbb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] validate_networks() for [('e8ede52f-f77b-4695-9cf8-08051f1c017e', None, None, None, None, None)] {{(pid=116467) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:29:18.294982 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e3f84bd0-264a-42f5-b3c6-66c839b33d6e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 14 microversion: 2.20 time: 0.205460 Jan 24 22:29:18.298458 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 125/253] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:18 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:18.302204 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e63e9138-649c-4787-ba74-ec006ddd3448 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:18.302957 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e63e9138-649c-4787-ba74-ec006ddd3448 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:18.310256 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e63e9138-649c-4787-ba74-ec006ddd3448 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:18.310754 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e63e9138-649c-4787-ba74-ec006ddd3448 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:18.311591 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e63e9138-649c-4787-ba74-ec006ddd3448 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:18.312176 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e63e9138-649c-4787-ba74-ec006ddd3448 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:18.510210 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e63e9138-649c-4787-ba74-ec006ddd3448 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:18.521390 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e63e9138-649c-4787-ba74-ec006ddd3448 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.223932 Jan 24 22:29:18.522175 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 126/254] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:18 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:18.790757 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-db5f1e28-0967-4d5c-9431-98054f45bdbb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Flavor limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:29:18.791164 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-db5f1e28-0967-4d5c-9431-98054f45bdbb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Image limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:29:18.791722 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-db5f1e28-0967-4d5c-9431-98054f45bdbb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Flavor pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:29:18.792181 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-db5f1e28-0967-4d5c-9431-98054f45bdbb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Image pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:29:18.792688 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-db5f1e28-0967-4d5c-9431-98054f45bdbb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:29:18.803055 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-db5f1e28-0967-4d5c-9431-98054f45bdbb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:18.803491 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-db5f1e28-0967-4d5c-9431-98054f45bdbb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:18.804309 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-db5f1e28-0967-4d5c-9431-98054f45bdbb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:18.804967 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-db5f1e28-0967-4d5c-9431-98054f45bdbb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:18.824840 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-db5f1e28-0967-4d5c-9431-98054f45bdbb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Getting quotas for project a78218846bb84713b4c02d9f95a25250. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:29:18.829238 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-db5f1e28-0967-4d5c-9431-98054f45bdbb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Getting quotas for user a0f51c8d0b8c4cc5ab76dae765c1b1c9 and project a78218846bb84713b4c02d9f95a25250. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:29:18.840410 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-db5f1e28-0967-4d5c-9431-98054f45bdbb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Going to run 1 instances... {{(pid=116467) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:29:18.842819 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-db5f1e28-0967-4d5c-9431-98054f45bdbb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fe12948-6887-4759-900b-f3ee39409e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:29:18.892622 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-db5f1e28-0967-4d5c-9431-98054f45bdbb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669190 Jan 24 22:29:18.893502 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 129/255] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:29:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 24 22:29:18.902856 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2e9c0d26-cb43-418b-b09d-f385f9520449 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:18.904108 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2e9c0d26-cb43-418b-b09d-f385f9520449 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:18.967015 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-2e9c0d26-cb43-418b-b09d-f385f9520449 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:18.979307 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2e9c0d26-cb43-418b-b09d-f385f9520449 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1217 microversion: 2.1 time: 0.079957 Jan 24 22:29:18.979959 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 127/256] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:18 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:19.232487 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-d43404dc-3e09-4cd9-acc1-9e56eb9bb1d7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:19.233599 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-d43404dc-3e09-4cd9-acc1-9e56eb9bb1d7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:19.240728 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d43404dc-3e09-4cd9-acc1-9e56eb9bb1d7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:19.241425 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d43404dc-3e09-4cd9-acc1-9e56eb9bb1d7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:19.242700 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d43404dc-3e09-4cd9-acc1-9e56eb9bb1d7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:19.243773 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d43404dc-3e09-4cd9-acc1-9e56eb9bb1d7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:19.306644 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e571caa9-e8be-45c9-bcfb-a2a581a09840 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:19.307865 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e571caa9-e8be-45c9-bcfb-a2a581a09840 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:19.315414 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e571caa9-e8be-45c9-bcfb-a2a581a09840 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:19.315855 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e571caa9-e8be-45c9-bcfb-a2a581a09840 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:19.316690 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e571caa9-e8be-45c9-bcfb-a2a581a09840 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:19.317148 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e571caa9-e8be-45c9-bcfb-a2a581a09840 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:19.386535 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-d43404dc-3e09-4cd9-acc1-9e56eb9bb1d7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 27738 microversion: 2.1 time: 0.157531 Jan 24 22:29:19.388321 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 130/257] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:19 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 27738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:19.513410 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e571caa9-e8be-45c9-bcfb-a2a581a09840 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 6451 microversion: 2.20 time: 0.210793 Jan 24 22:29:19.514057 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 128/258] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:19 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 6451 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:29:19.540489 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-577c4c62-431e-4e93-9c7b-f9bfac79fa51 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:19.541397 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-577c4c62-431e-4e93-9c7b-f9bfac79fa51 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:19.550919 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-577c4c62-431e-4e93-9c7b-f9bfac79fa51 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:19.551854 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-577c4c62-431e-4e93-9c7b-f9bfac79fa51 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:19.552952 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-577c4c62-431e-4e93-9c7b-f9bfac79fa51 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:19.553600 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-577c4c62-431e-4e93-9c7b-f9bfac79fa51 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:19.789090 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-577c4c62-431e-4e93-9c7b-f9bfac79fa51 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:19.796752 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-577c4c62-431e-4e93-9c7b-f9bfac79fa51 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.261209 Jan 24 22:29:19.798805 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 131/259] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:19 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:20.005491 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c2e970ad-1bef-42fa-b301-41b680bc256b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:20.010271 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c2e970ad-1bef-42fa-b301-41b680bc256b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:20.020831 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c2e970ad-1bef-42fa-b301-41b680bc256b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:20.022120 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c2e970ad-1bef-42fa-b301-41b680bc256b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:20.023774 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c2e970ad-1bef-42fa-b301-41b680bc256b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:20.026563 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c2e970ad-1bef-42fa-b301-41b680bc256b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:20.111769 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c2e970ad-1bef-42fa-b301-41b680bc256b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:20.119336 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c2e970ad-1bef-42fa-b301-41b680bc256b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1269 microversion: 2.1 time: 0.126580 Jan 24 22:29:20.120500 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 129/260] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:19 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1269 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:20.400449 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c36eeca2-df41-4497-b0ac-a685a9143a78 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:20.401533 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c36eeca2-df41-4497-b0ac-a685a9143a78 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:20.409747 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c36eeca2-df41-4497-b0ac-a685a9143a78 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:20.410291 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c36eeca2-df41-4497-b0ac-a685a9143a78 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:20.411328 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c36eeca2-df41-4497-b0ac-a685a9143a78 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:20.411779 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c36eeca2-df41-4497-b0ac-a685a9143a78 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:20.525726 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2cbdc272-1c3b-4370-96f7-e7b9c285ab3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:20.526655 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2cbdc272-1c3b-4370-96f7-e7b9c285ab3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:20.533055 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2cbdc272-1c3b-4370-96f7-e7b9c285ab3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:20.533472 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2cbdc272-1c3b-4370-96f7-e7b9c285ab3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:20.534252 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2cbdc272-1c3b-4370-96f7-e7b9c285ab3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:20.534681 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2cbdc272-1c3b-4370-96f7-e7b9c285ab3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:20.603679 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c36eeca2-df41-4497-b0ac-a685a9143a78 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 27859 microversion: 2.1 time: 0.207290 Jan 24 22:29:20.604435 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 132/261] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:20 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 27859 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:20.765113 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2cbdc272-1c3b-4370-96f7-e7b9c285ab3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 10009 microversion: 2.20 time: 0.243777 Jan 24 22:29:20.768527 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 130/262] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:20 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 10009 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:29:20.820102 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a67a1082-0208-4255-9bc4-a5c86a262cc3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:20.821231 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a67a1082-0208-4255-9bc4-a5c86a262cc3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:20.828790 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a67a1082-0208-4255-9bc4-a5c86a262cc3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:20.829408 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a67a1082-0208-4255-9bc4-a5c86a262cc3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:20.830407 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a67a1082-0208-4255-9bc4-a5c86a262cc3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:20.830862 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a67a1082-0208-4255-9bc4-a5c86a262cc3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:20.990413 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a67a1082-0208-4255-9bc4-a5c86a262cc3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:21.000514 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a67a1082-0208-4255-9bc4-a5c86a262cc3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.184863 Jan 24 22:29:21.001117 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 133/263] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:20 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:21.137777 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e8fb18dc-12a7-4059-a185-31686548b533 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:21.138448 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e8fb18dc-12a7-4059-a185-31686548b533 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:21.146324 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e8fb18dc-12a7-4059-a185-31686548b533 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:21.146768 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e8fb18dc-12a7-4059-a185-31686548b533 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:21.147587 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e8fb18dc-12a7-4059-a185-31686548b533 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:21.148216 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e8fb18dc-12a7-4059-a185-31686548b533 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:21.444206 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9ebde99a-08e5-4fd0-9b32-82124656cef3 tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] Calling method '.version_select at 0x7f7e5d4c7280>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:21.518690 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9ebde99a-08e5-4fd0-9b32-82124656cef3 tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/39ef5956-b8e3-4093-814c-1cc180b141ea" status: 200 len: 351 microversion: 2.1 time: 0.078842 Jan 24 22:29:21.519608 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 134/264] 10.222.0.84 () {58 vars in 1244 bytes} [Mon Jan 24 22:29:21 2022] GET /compute/v2.1/os-volumes/39ef5956-b8e3-4093-814c-1cc180b141ea => generated 351 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:29:21.615232 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-efe9ec0b-3d50-44f2-81dd-d4931f15f650 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:21.616453 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-efe9ec0b-3d50-44f2-81dd-d4931f15f650 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:21.619140 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e8fb18dc-12a7-4059-a185-31686548b533 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:21.627536 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-efe9ec0b-3d50-44f2-81dd-d4931f15f650 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:21.630275 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-efe9ec0b-3d50-44f2-81dd-d4931f15f650 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:21.631352 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-efe9ec0b-3d50-44f2-81dd-d4931f15f650 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:21.631800 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e8fb18dc-12a7-4059-a185-31686548b533 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1317 microversion: 2.1 time: 0.498450 Jan 24 22:29:21.632553 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 131/265] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:21 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:21.642225 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-efe9ec0b-3d50-44f2-81dd-d4931f15f650 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:21.776556 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3ec95fc6-af7f-490b-b314-c98ab258eef7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:21.778718 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3ec95fc6-af7f-490b-b314-c98ab258eef7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:21.788703 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3ec95fc6-af7f-490b-b314-c98ab258eef7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:21.789190 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3ec95fc6-af7f-490b-b314-c98ab258eef7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:21.790173 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3ec95fc6-af7f-490b-b314-c98ab258eef7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:21.790734 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3ec95fc6-af7f-490b-b314-c98ab258eef7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:21.796834 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-efe9ec0b-3d50-44f2-81dd-d4931f15f650 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 28151 microversion: 2.1 time: 0.184822 Jan 24 22:29:21.797911 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 135/266] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:21 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 28151 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:29:21.924835 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3ec95fc6-af7f-490b-b314-c98ab258eef7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 13887 microversion: 2.20 time: 0.151999 Jan 24 22:29:21.926586 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 132/267] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:21 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 13887 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:29:22.021194 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-00ee8e9a-f848-44f1-9ef6-a0feef0b0408 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:22.021850 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-00ee8e9a-f848-44f1-9ef6-a0feef0b0408 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:22.038318 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-00ee8e9a-f848-44f1-9ef6-a0feef0b0408 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:22.040104 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-00ee8e9a-f848-44f1-9ef6-a0feef0b0408 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:22.044379 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-00ee8e9a-f848-44f1-9ef6-a0feef0b0408 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:22.044826 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-00ee8e9a-f848-44f1-9ef6-a0feef0b0408 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:22.155000 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-ae5298ae-8f82-4505-84fd-6b62b751e677 req-0796a3b2-24c4-4339-9278-9ab8097c7e0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a5b58c-493c-46a9-a297-4fd94047866f", "tag": "344c5aaf-3a45-41e2-9d8d-0acafb3d1e31"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:22.157682 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:29:22.157682 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:29:22.171498 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-ae5298ae-8f82-4505-84fd-6b62b751e677 req-0796a3b2-24c4-4339-9278-9ab8097c7e0f service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:22.172086 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-ae5298ae-8f82-4505-84fd-6b62b751e677 req-0796a3b2-24c4-4339-9278-9ab8097c7e0f service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:22.186354 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-ae5298ae-8f82-4505-84fd-6b62b751e677 req-0796a3b2-24c4-4339-9278-9ab8097c7e0f service nova] Creating event network-changed:344c5aaf-3a45-41e2-9d8d-0acafb3d1e31 for instance 14a5b58c-493c-46a9-a297-4fd94047866f on hv-cinder-81322 Jan 24 22:29:22.192198 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-ae5298ae-8f82-4505-84fd-6b62b751e677 req-0796a3b2-24c4-4339-9278-9ab8097c7e0f service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040642 Jan 24 22:29:22.192998 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 133/268] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:22.266918 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-00ee8e9a-f848-44f1-9ef6-a0feef0b0408 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:22.275427 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-00ee8e9a-f848-44f1-9ef6-a0feef0b0408 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.261312 Jan 24 22:29:22.276635 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 136/269] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:22 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:22.653918 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3eea82dd-567b-4b31-89a9-413b7c32eb45 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:22.655298 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3eea82dd-567b-4b31-89a9-413b7c32eb45 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:22.664021 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3eea82dd-567b-4b31-89a9-413b7c32eb45 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:22.664584 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3eea82dd-567b-4b31-89a9-413b7c32eb45 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:22.665427 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3eea82dd-567b-4b31-89a9-413b7c32eb45 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:22.665858 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3eea82dd-567b-4b31-89a9-413b7c32eb45 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:22.810502 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-917201a6-1264-4b1f-8f4e-aa7462f34388 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:22.812108 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-917201a6-1264-4b1f-8f4e-aa7462f34388 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:22.819654 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-917201a6-1264-4b1f-8f4e-aa7462f34388 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:22.820447 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-917201a6-1264-4b1f-8f4e-aa7462f34388 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:22.820760 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3eea82dd-567b-4b31-89a9-413b7c32eb45 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:22.822179 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-917201a6-1264-4b1f-8f4e-aa7462f34388 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:22.822968 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-917201a6-1264-4b1f-8f4e-aa7462f34388 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:22.838297 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3eea82dd-567b-4b31-89a9-413b7c32eb45 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1317 microversion: 2.1 time: 0.191567 Jan 24 22:29:22.845943 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 134/270] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:22 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:22.941803 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-917201a6-1264-4b1f-8f4e-aa7462f34388 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 28151 microversion: 2.1 time: 0.135535 Jan 24 22:29:22.943302 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 137/271] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:22 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 28151 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:29:22.943876 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-55bb53b9-03c9-474a-8418-5b647fe90eb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:22.945066 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-55bb53b9-03c9-474a-8418-5b647fe90eb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:22.952726 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-55bb53b9-03c9-474a-8418-5b647fe90eb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:22.953406 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-55bb53b9-03c9-474a-8418-5b647fe90eb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:22.954378 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-55bb53b9-03c9-474a-8418-5b647fe90eb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:22.955032 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-55bb53b9-03c9-474a-8418-5b647fe90eb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:22.985386 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-fad9a236-b018-4511-ae81-4cfa7cbc0328 tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] Calling method '.version_select at 0x7f7e5d4dd160>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:23.045784 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-fad9a236-b018-4511-ae81-4cfa7cbc0328 tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/b33b09b9-b1f4-4710-be67-849e6947b7dc" status: 200 len: 351 microversion: 2.1 time: 0.064368 Jan 24 22:29:23.052120 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 138/272] 10.222.0.84 () {58 vars in 1244 bytes} [Mon Jan 24 22:29:22 2022] GET /compute/v2.1/os-volumes/b33b09b9-b1f4-4710-be67-849e6947b7dc => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:23.202178 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-55bb53b9-03c9-474a-8418-5b647fe90eb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 16486 microversion: 2.20 time: 0.268541 Jan 24 22:29:23.202835 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 135/273] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:22 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 16486 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:29:23.293317 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-cf6eee77-e3ba-4b9d-9c71-96381f505fdd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:23.294914 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-cf6eee77-e3ba-4b9d-9c71-96381f505fdd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:23.313440 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cf6eee77-e3ba-4b9d-9c71-96381f505fdd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:23.314056 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cf6eee77-e3ba-4b9d-9c71-96381f505fdd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:23.315572 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cf6eee77-e3ba-4b9d-9c71-96381f505fdd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:23.315992 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cf6eee77-e3ba-4b9d-9c71-96381f505fdd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:23.530438 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-cf6eee77-e3ba-4b9d-9c71-96381f505fdd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:23.543330 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-cf6eee77-e3ba-4b9d-9c71-96381f505fdd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.255022 Jan 24 22:29:23.544111 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 139/274] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:23 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:23.856442 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-95dec433-b4a5-4c72-8f53-67db2cd411e7 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:23.857723 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-95dec433-b4a5-4c72-8f53-67db2cd411e7 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:23.866180 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-95dec433-b4a5-4c72-8f53-67db2cd411e7 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:23.866803 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-95dec433-b4a5-4c72-8f53-67db2cd411e7 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:23.868169 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-95dec433-b4a5-4c72-8f53-67db2cd411e7 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:23.868779 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-95dec433-b4a5-4c72-8f53-67db2cd411e7 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:23.954312 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9157a70a-c095-4ae9-a622-848ae7330868 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:23.956238 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9157a70a-c095-4ae9-a622-848ae7330868 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:23.964455 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9157a70a-c095-4ae9-a622-848ae7330868 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:23.964877 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9157a70a-c095-4ae9-a622-848ae7330868 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:23.966144 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9157a70a-c095-4ae9-a622-848ae7330868 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:23.966580 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9157a70a-c095-4ae9-a622-848ae7330868 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:24.026242 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-95dec433-b4a5-4c72-8f53-67db2cd411e7 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:24.034540 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-95dec433-b4a5-4c72-8f53-67db2cd411e7 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1317 microversion: 2.1 time: 0.182661 Jan 24 22:29:24.035050 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 136/275] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:23 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:24.108687 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9157a70a-c095-4ae9-a622-848ae7330868 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 28151 microversion: 2.1 time: 0.158004 Jan 24 22:29:24.109391 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 140/276] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:23 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 28151 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:29:24.214862 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3acf6df7-0ef0-4734-bb3d-0ba1025940d8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:24.216046 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3acf6df7-0ef0-4734-bb3d-0ba1025940d8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:24.222743 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3acf6df7-0ef0-4734-bb3d-0ba1025940d8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:24.223523 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3acf6df7-0ef0-4734-bb3d-0ba1025940d8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:24.224385 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3acf6df7-0ef0-4734-bb3d-0ba1025940d8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:24.224881 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3acf6df7-0ef0-4734-bb3d-0ba1025940d8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:24.364503 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3acf6df7-0ef0-4734-bb3d-0ba1025940d8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 17602 microversion: 2.20 time: 0.154018 Jan 24 22:29:24.365266 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 137/277] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:24 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 17602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:24.453279 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ba3900b8-c101-4d14-b980-2275f1d28a98 tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] Calling method '.version_select at 0x7f7e5d47e1f0>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:24.499100 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ba3900b8-c101-4d14-b980-2275f1d28a98 tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/f4354efe-07f6-4cce-a94f-cd3794b74856" status: 200 len: 350 microversion: 2.1 time: 0.049688 Jan 24 22:29:24.499658 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 141/278] 10.222.0.84 () {58 vars in 1244 bytes} [Mon Jan 24 22:29:24 2022] GET /compute/v2.1/os-volumes/f4354efe-07f6-4cce-a94f-cd3794b74856 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:24.514978 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-54aff5bc-08a5-41fd-865d-9b09fbd1c69d tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] Calling method '.version_select at 0x7f7e5d3ff9d0>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:24.564344 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-395415dc-6ad7-4c48-998d-975e595408e0 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:24.565352 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-395415dc-6ad7-4c48-998d-975e595408e0 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:24.571679 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-395415dc-6ad7-4c48-998d-975e595408e0 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:24.572126 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-395415dc-6ad7-4c48-998d-975e595408e0 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:24.572947 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-395415dc-6ad7-4c48-998d-975e595408e0 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:24.573399 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-395415dc-6ad7-4c48-998d-975e595408e0 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:24.603613 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-54aff5bc-08a5-41fd-865d-9b09fbd1c69d tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] 10.222.0.84 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096441 Jan 24 22:29:24.604189 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 138/279] 10.222.0.84 () {58 vars in 1133 bytes} [Mon Jan 24 22:29:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:24.616208 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-697172f0-aa19-4c04-b76b-d5e8f97907f7 tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] Calling method '.version_select at 0x7f7e5d50bdc0>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:24.701887 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-697172f0-aa19-4c04-b76b-d5e8f97907f7 tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] 10.222.0.84 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089108 Jan 24 22:29:24.702478 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 139/280] 10.222.0.84 () {58 vars in 1148 bytes} [Mon Jan 24 22:29:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:29:24.714080 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-4da6273e-04bd-4ad7-93d8-c35197c0b308 tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] Calling method '.version_select at 0x7f7e5d3ff5e0>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:24.731256 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-395415dc-6ad7-4c48-998d-975e595408e0 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:24.739914 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-395415dc-6ad7-4c48-998d-975e595408e0 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.180512 Jan 24 22:29:24.740560 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 142/281] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:24 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:24.798967 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-4da6273e-04bd-4ad7-93d8-c35197c0b308 tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] 10.222.0.84 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088557 Jan 24 22:29:24.799740 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 140/282] 10.222.0.84 () {58 vars in 1133 bytes} [Mon Jan 24 22:29:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:24.811301 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-8861541b-4f9d-44ab-b8b8-0507094cf538 tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] Calling method '.version_select at 0x7f7e5efac430>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:24.892517 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-8861541b-4f9d-44ab-b8b8-0507094cf538 tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] 10.222.0.84 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085135 Jan 24 22:29:24.893130 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 143/283] 10.222.0.84 () {58 vars in 1166 bytes} [Mon Jan 24 22:29:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:24.904615 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-4c5e186b-ae39-494f-84fe-1d54b0375c03 tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] Calling method '.version_select at 0x7f7e5dd685e0>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:24.983094 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-4c5e186b-ae39-494f-84fe-1d54b0375c03 tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082104 Jan 24 22:29:24.983671 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 141/284] 10.222.0.84 () {58 vars in 1169 bytes} [Mon Jan 24 22:29:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:29:24.996628 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-527cd085-9c78-405c-a4f6-6327b22882cd tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] Calling method '.version_select at 0x7f7e5d47e9d0>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:25.051477 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-578767af-da00-4b47-987d-2ded39717852 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:25.052943 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-578767af-da00-4b47-987d-2ded39717852 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:25.060443 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-578767af-da00-4b47-987d-2ded39717852 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:25.060815 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-578767af-da00-4b47-987d-2ded39717852 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:25.062350 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-578767af-da00-4b47-987d-2ded39717852 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:25.062794 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-578767af-da00-4b47-987d-2ded39717852 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:25.076185 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-527cd085-9c78-405c-a4f6-6327b22882cd tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083176 Jan 24 22:29:25.076750 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 144/285] 10.222.0.84 () {58 vars in 1154 bytes} [Mon Jan 24 22:29:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:25.088140 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-09a2548e-fe46-4aa0-ad30-6aff4cf6422b tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] Calling method '.version_select at 0x7f7e5d47e3a0>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:25.171224 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-09a2548e-fe46-4aa0-ad30-6aff4cf6422b tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087016 Jan 24 22:29:25.171825 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 145/286] 10.222.0.84 () {58 vars in 1187 bytes} [Mon Jan 24 22:29:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:25.177335 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3f8275d7-9a1b-42ed-a828-f140bd1f4a29 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:25.178762 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-3f8275d7-9a1b-42ed-a828-f140bd1f4a29 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:25.186070 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3f8275d7-9a1b-42ed-a828-f140bd1f4a29 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:25.186628 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3f8275d7-9a1b-42ed-a828-f140bd1f4a29 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:25.187523 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3f8275d7-9a1b-42ed-a828-f140bd1f4a29 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:25.188015 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3f8275d7-9a1b-42ed-a828-f140bd1f4a29 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:25.202653 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-578767af-da00-4b47-987d-2ded39717852 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:25.210662 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-578767af-da00-4b47-987d-2ded39717852 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1317 microversion: 2.1 time: 0.162759 Jan 24 22:29:25.211289 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 142/287] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:25 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:25.215881 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-581432ad-ab70-4722-b603-b3377138f42e tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] Calling method '.version_select at 0x7f7e5ef52940>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:25.295580 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-581432ad-ab70-4722-b603-b3377138f42e tempest-VolumesTestJSON-1514221027 tempest-VolumesTestJSON-1514221027-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083289 Jan 24 22:29:25.296141 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 143/288] 10.222.0.84 () {58 vars in 1154 bytes} [Mon Jan 24 22:29:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:25.305086 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-3f8275d7-9a1b-42ed-a828-f140bd1f4a29 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 28151 microversion: 2.1 time: 0.131094 Jan 24 22:29:25.305914 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 146/289] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:25 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 28151 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:25.376149 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e6d71d83-b29b-42e0-84ba-251d3b48801b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:25.377170 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e6d71d83-b29b-42e0-84ba-251d3b48801b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:25.388545 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e6d71d83-b29b-42e0-84ba-251d3b48801b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:25.389075 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e6d71d83-b29b-42e0-84ba-251d3b48801b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:25.391328 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e6d71d83-b29b-42e0-84ba-251d3b48801b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:25.391772 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e6d71d83-b29b-42e0-84ba-251d3b48801b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:25.538506 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e6d71d83-b29b-42e0-84ba-251d3b48801b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 18772 microversion: 2.20 time: 0.165967 Jan 24 22:29:25.539135 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 144/290] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:25 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 18772 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:25.758684 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ba99b761-8c18-4257-914f-9341259ae268 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:25.759333 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ba99b761-8c18-4257-914f-9341259ae268 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:25.767029 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ba99b761-8c18-4257-914f-9341259ae268 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:25.767479 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ba99b761-8c18-4257-914f-9341259ae268 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:25.768250 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ba99b761-8c18-4257-914f-9341259ae268 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:25.768684 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ba99b761-8c18-4257-914f-9341259ae268 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:25.910658 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ba99b761-8c18-4257-914f-9341259ae268 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:25.924096 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ba99b761-8c18-4257-914f-9341259ae268 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.169240 Jan 24 22:29:25.925302 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 147/291] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:25 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:26.232614 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-993f6fc2-ebb5-4169-ab7e-fd7fe5c0c595 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:26.233789 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-993f6fc2-ebb5-4169-ab7e-fd7fe5c0c595 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:26.244883 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-993f6fc2-ebb5-4169-ab7e-fd7fe5c0c595 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:26.245361 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-993f6fc2-ebb5-4169-ab7e-fd7fe5c0c595 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:26.246126 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-993f6fc2-ebb5-4169-ab7e-fd7fe5c0c595 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:26.246548 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-993f6fc2-ebb5-4169-ab7e-fd7fe5c0c595 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:26.318174 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2fee5739-7223-4e89-bb1f-cb01872fc617 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:26.319841 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2fee5739-7223-4e89-bb1f-cb01872fc617 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:26.326648 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2fee5739-7223-4e89-bb1f-cb01872fc617 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:26.327087 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2fee5739-7223-4e89-bb1f-cb01872fc617 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:26.327950 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2fee5739-7223-4e89-bb1f-cb01872fc617 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:26.328408 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2fee5739-7223-4e89-bb1f-cb01872fc617 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:26.393710 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-993f6fc2-ebb5-4169-ab7e-fd7fe5c0c595 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:26.401818 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-993f6fc2-ebb5-4169-ab7e-fd7fe5c0c595 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1317 microversion: 2.1 time: 0.176369 Jan 24 22:29:26.402408 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 145/292] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:26 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:26.468834 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2fee5739-7223-4e89-bb1f-cb01872fc617 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 28441 microversion: 2.1 time: 0.154962 Jan 24 22:29:26.469822 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 148/293] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:26 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 28441 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:29:26.550078 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7f94a218-5071-4d6c-a35d-a6ad2baddfd8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:26.550932 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7f94a218-5071-4d6c-a35d-a6ad2baddfd8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:26.557751 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7f94a218-5071-4d6c-a35d-a6ad2baddfd8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:26.558263 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7f94a218-5071-4d6c-a35d-a6ad2baddfd8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:26.559131 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7f94a218-5071-4d6c-a35d-a6ad2baddfd8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:26.560005 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7f94a218-5071-4d6c-a35d-a6ad2baddfd8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:26.680899 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7f94a218-5071-4d6c-a35d-a6ad2baddfd8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 20946 microversion: 2.20 time: 0.134488 Jan 24 22:29:26.681957 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 146/294] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:26 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 20946 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:29:26.945752 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-bb8b9fa6-42e6-4f8e-beaa-93185b667244 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:26.946213 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-bb8b9fa6-42e6-4f8e-beaa-93185b667244 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:26.956652 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bb8b9fa6-42e6-4f8e-beaa-93185b667244 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:26.957371 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bb8b9fa6-42e6-4f8e-beaa-93185b667244 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:26.958373 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bb8b9fa6-42e6-4f8e-beaa-93185b667244 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:26.959025 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bb8b9fa6-42e6-4f8e-beaa-93185b667244 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:27.097105 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-bb8b9fa6-42e6-4f8e-beaa-93185b667244 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:27.104790 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-bb8b9fa6-42e6-4f8e-beaa-93185b667244 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.165459 Jan 24 22:29:27.105387 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 149/295] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:26 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:27.419304 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c677944b-bd3a-4f7b-9084-0ff49513b082 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:27.420091 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c677944b-bd3a-4f7b-9084-0ff49513b082 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:27.427168 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c677944b-bd3a-4f7b-9084-0ff49513b082 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:27.427667 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c677944b-bd3a-4f7b-9084-0ff49513b082 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:27.428530 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c677944b-bd3a-4f7b-9084-0ff49513b082 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:27.429458 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c677944b-bd3a-4f7b-9084-0ff49513b082 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:27.481895 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-d7286726-0794-4da3-b59e-c35d6021e491 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:27.482712 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-d7286726-0794-4da3-b59e-c35d6021e491 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:27.488979 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d7286726-0794-4da3-b59e-c35d6021e491 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:27.489449 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d7286726-0794-4da3-b59e-c35d6021e491 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:27.490194 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d7286726-0794-4da3-b59e-c35d6021e491 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:27.490618 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d7286726-0794-4da3-b59e-c35d6021e491 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:27.640955 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c677944b-bd3a-4f7b-9084-0ff49513b082 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:27.647133 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-d7286726-0794-4da3-b59e-c35d6021e491 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 28605 microversion: 2.1 time: 0.169133 Jan 24 22:29:27.650288 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c677944b-bd3a-4f7b-9084-0ff49513b082 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1317 microversion: 2.1 time: 0.235163 Jan 24 22:29:27.653139 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 147/297] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:27 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:27.653219 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 150/297] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:27 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 28605 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:27.694178 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a519c45a-2595-4b39-a130-06559ba203d5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:27.695344 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a519c45a-2595-4b39-a130-06559ba203d5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:27.701842 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a519c45a-2595-4b39-a130-06559ba203d5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:27.702236 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a519c45a-2595-4b39-a130-06559ba203d5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:27.703004 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a519c45a-2595-4b39-a130-06559ba203d5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:27.703492 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a519c45a-2595-4b39-a130-06559ba203d5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:27.828809 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a519c45a-2595-4b39-a130-06559ba203d5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 22113 microversion: 2.20 time: 0.138111 Jan 24 22:29:27.829987 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 148/298] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:27 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 22113 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:28.122520 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-99631858-e525-453c-a7df-48cc4cb40f3c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:28.123277 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-99631858-e525-453c-a7df-48cc4cb40f3c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:28.130400 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-99631858-e525-453c-a7df-48cc4cb40f3c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:28.131052 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-99631858-e525-453c-a7df-48cc4cb40f3c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:28.132049 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-99631858-e525-453c-a7df-48cc4cb40f3c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:28.132650 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-99631858-e525-453c-a7df-48cc4cb40f3c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:28.309456 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-99631858-e525-453c-a7df-48cc4cb40f3c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:28.317421 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-99631858-e525-453c-a7df-48cc4cb40f3c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.199290 Jan 24 22:29:28.317989 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 151/299] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:28 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:28.630673 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-2296a343-1b6e-46da-9fff-03c3012d1486 req-66e6da17-762f-44f0-8af5-138c9dd56bee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a5b58c-493c-46a9-a297-4fd94047866f", "name": "network-vif-plugged", "status": "completed", "tag": "344c5aaf-3a45-41e2-9d8d-0acafb3d1e31"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:28.632781 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:29:28.632781 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:29:28.644056 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-2296a343-1b6e-46da-9fff-03c3012d1486 req-66e6da17-762f-44f0-8af5-138c9dd56bee service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:28.651153 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-2296a343-1b6e-46da-9fff-03c3012d1486 req-66e6da17-762f-44f0-8af5-138c9dd56bee service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:28.659572 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-184a816d-6242-4c97-a5f9-bcf031057eef tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:28.660553 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-184a816d-6242-4c97-a5f9-bcf031057eef tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:28.664506 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-2296a343-1b6e-46da-9fff-03c3012d1486 req-66e6da17-762f-44f0-8af5-138c9dd56bee service nova] Creating event network-vif-plugged:344c5aaf-3a45-41e2-9d8d-0acafb3d1e31 for instance 14a5b58c-493c-46a9-a297-4fd94047866f on hv-cinder-81322 Jan 24 22:29:28.667817 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-184a816d-6242-4c97-a5f9-bcf031057eef tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:28.669210 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-184a816d-6242-4c97-a5f9-bcf031057eef tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:28.669654 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-2296a343-1b6e-46da-9fff-03c3012d1486 req-66e6da17-762f-44f0-8af5-138c9dd56bee service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042960 Jan 24 22:29:28.670245 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 149/300] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:28.670992 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-184a816d-6242-4c97-a5f9-bcf031057eef tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:28.671694 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-184a816d-6242-4c97-a5f9-bcf031057eef tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:28.675577 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-5fb405e8-016f-4ace-8b73-ad93a45152c4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:28.676265 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-5fb405e8-016f-4ace-8b73-ad93a45152c4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:28.691303 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5fb405e8-016f-4ace-8b73-ad93a45152c4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:28.691753 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5fb405e8-016f-4ace-8b73-ad93a45152c4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:28.692538 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5fb405e8-016f-4ace-8b73-ad93a45152c4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:28.692965 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5fb405e8-016f-4ace-8b73-ad93a45152c4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:28.823796 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-184a816d-6242-4c97-a5f9-bcf031057eef tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 28607 microversion: 2.1 time: 0.168364 Jan 24 22:29:28.824819 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 152/301] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:28 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 28607 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:28.843233 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6885b777-79f3-473a-ad62-d732c5fe23b7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:28.844761 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6885b777-79f3-473a-ad62-d732c5fe23b7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:28.857094 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6885b777-79f3-473a-ad62-d732c5fe23b7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:28.858011 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6885b777-79f3-473a-ad62-d732c5fe23b7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:28.863633 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-5fb405e8-016f-4ace-8b73-ad93a45152c4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:28.867215 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6885b777-79f3-473a-ad62-d732c5fe23b7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:28.872047 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6885b777-79f3-473a-ad62-d732c5fe23b7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:28.875454 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-5fb405e8-016f-4ace-8b73-ad93a45152c4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1317 microversion: 2.1 time: 0.201986 Jan 24 22:29:28.885248 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 150/302] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:28 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:29.014271 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6885b777-79f3-473a-ad62-d732c5fe23b7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 23225 microversion: 2.20 time: 0.177741 Jan 24 22:29:29.015548 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 153/303] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:28 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 23225 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:29:29.334940 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-65fca2b2-26b7-4fa5-a381-0109e0e9276c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:29.335238 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-65fca2b2-26b7-4fa5-a381-0109e0e9276c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:29.342637 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-65fca2b2-26b7-4fa5-a381-0109e0e9276c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:29.343404 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-65fca2b2-26b7-4fa5-a381-0109e0e9276c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:29.344386 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-65fca2b2-26b7-4fa5-a381-0109e0e9276c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:29.345341 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-65fca2b2-26b7-4fa5-a381-0109e0e9276c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:29.489824 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-65fca2b2-26b7-4fa5-a381-0109e0e9276c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:29.497555 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-65fca2b2-26b7-4fa5-a381-0109e0e9276c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.166804 Jan 24 22:29:29.499087 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 151/304] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:29 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:29.837504 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6bc3204c-6f1a-4c5b-938c-4e22a69702a7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:29.838494 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6bc3204c-6f1a-4c5b-938c-4e22a69702a7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:29.844931 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6bc3204c-6f1a-4c5b-938c-4e22a69702a7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:29.845656 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6bc3204c-6f1a-4c5b-938c-4e22a69702a7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:29.846875 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6bc3204c-6f1a-4c5b-938c-4e22a69702a7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:29.847339 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6bc3204c-6f1a-4c5b-938c-4e22a69702a7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:29.893222 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-41dc237e-c8d0-4308-aacf-69b24f634ea1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:29.894109 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-41dc237e-c8d0-4308-aacf-69b24f634ea1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:29.900545 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-41dc237e-c8d0-4308-aacf-69b24f634ea1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:29.901246 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-41dc237e-c8d0-4308-aacf-69b24f634ea1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:29.902260 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-41dc237e-c8d0-4308-aacf-69b24f634ea1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:29.902782 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-41dc237e-c8d0-4308-aacf-69b24f634ea1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:29.973038 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6bc3204c-6f1a-4c5b-938c-4e22a69702a7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 28607 microversion: 2.1 time: 0.138545 Jan 24 22:29:29.973038 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 154/305] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:29 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 28607 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:30.030241 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-003ce071-944e-43a5-8819-b150f0b2c3b7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:30.032227 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-003ce071-944e-43a5-8819-b150f0b2c3b7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:30.041884 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-003ce071-944e-43a5-8819-b150f0b2c3b7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:30.042332 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-003ce071-944e-43a5-8819-b150f0b2c3b7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:30.045933 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-003ce071-944e-43a5-8819-b150f0b2c3b7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:30.046619 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-003ce071-944e-43a5-8819-b150f0b2c3b7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:30.059478 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-41dc237e-c8d0-4308-aacf-69b24f634ea1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:30.069056 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-41dc237e-c8d0-4308-aacf-69b24f634ea1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1317 microversion: 2.1 time: 0.179677 Jan 24 22:29:30.069791 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 152/306] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:29 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:30.178851 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-003ce071-944e-43a5-8819-b150f0b2c3b7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 24090 microversion: 2.20 time: 0.154796 Jan 24 22:29:30.179808 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 155/307] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:30 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 24090 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:29:30.516089 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-88830dd3-9e6e-4e14-822d-6f453f422e9d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:30.516698 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-88830dd3-9e6e-4e14-822d-6f453f422e9d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:30.531623 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-88830dd3-9e6e-4e14-822d-6f453f422e9d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:30.539203 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-88830dd3-9e6e-4e14-822d-6f453f422e9d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:30.540278 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-88830dd3-9e6e-4e14-822d-6f453f422e9d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:30.541004 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-88830dd3-9e6e-4e14-822d-6f453f422e9d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:30.702413 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-88830dd3-9e6e-4e14-822d-6f453f422e9d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:30.710782 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-88830dd3-9e6e-4e14-822d-6f453f422e9d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.199301 Jan 24 22:29:30.711540 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 153/308] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:30 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:30.985174 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0432722f-d313-4a4a-ba96-4ac93d132c6a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:30.986268 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0432722f-d313-4a4a-ba96-4ac93d132c6a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:30.994707 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0432722f-d313-4a4a-ba96-4ac93d132c6a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:30.995292 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0432722f-d313-4a4a-ba96-4ac93d132c6a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:30.996579 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0432722f-d313-4a4a-ba96-4ac93d132c6a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:30.997067 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0432722f-d313-4a4a-ba96-4ac93d132c6a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:31.087337 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-891ed5e6-2656-4a1f-b9c9-7703ae9208c8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:31.088059 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-891ed5e6-2656-4a1f-b9c9-7703ae9208c8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:31.094568 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-891ed5e6-2656-4a1f-b9c9-7703ae9208c8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:31.095022 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-891ed5e6-2656-4a1f-b9c9-7703ae9208c8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:31.095811 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-891ed5e6-2656-4a1f-b9c9-7703ae9208c8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:31.096225 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-891ed5e6-2656-4a1f-b9c9-7703ae9208c8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:31.109526 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0432722f-d313-4a4a-ba96-4ac93d132c6a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 28607 microversion: 2.1 time: 0.129854 Jan 24 22:29:31.110183 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 156/309] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:30 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 28607 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:31.191224 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b2a84b26-e185-441e-a78b-1f878e4562c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:31.192484 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b2a84b26-e185-441e-a78b-1f878e4562c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:31.202496 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b2a84b26-e185-441e-a78b-1f878e4562c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:31.203152 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b2a84b26-e185-441e-a78b-1f878e4562c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:31.204241 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b2a84b26-e185-441e-a78b-1f878e4562c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:31.204854 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b2a84b26-e185-441e-a78b-1f878e4562c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:31.245953 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-891ed5e6-2656-4a1f-b9c9-7703ae9208c8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:31.253636 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-891ed5e6-2656-4a1f-b9c9-7703ae9208c8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1507 microversion: 2.1 time: 0.171224 Jan 24 22:29:31.254253 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 154/310] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:31 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:31.332974 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b2a84b26-e185-441e-a78b-1f878e4562c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 24811 microversion: 2.20 time: 0.145656 Jan 24 22:29:31.333704 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 157/311] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:31 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 24811 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:29:31.728427 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-f9297b5e-63ef-4764-b22a-cc5b5d939a4c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:31.728946 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-f9297b5e-63ef-4764-b22a-cc5b5d939a4c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:31.735651 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f9297b5e-63ef-4764-b22a-cc5b5d939a4c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:31.736087 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f9297b5e-63ef-4764-b22a-cc5b5d939a4c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:31.736853 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f9297b5e-63ef-4764-b22a-cc5b5d939a4c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:31.737300 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f9297b5e-63ef-4764-b22a-cc5b5d939a4c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:31.882579 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-f9297b5e-63ef-4764-b22a-cc5b5d939a4c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:31.890389 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-f9297b5e-63ef-4764-b22a-cc5b5d939a4c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.165841 Jan 24 22:29:31.890949 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 155/312] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:31 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:32.121968 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3260df24-f604-4759-91bb-bd0d1d9c26a5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:32.122958 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-3260df24-f604-4759-91bb-bd0d1d9c26a5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:32.129919 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3260df24-f604-4759-91bb-bd0d1d9c26a5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:32.130347 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3260df24-f604-4759-91bb-bd0d1d9c26a5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:32.131120 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3260df24-f604-4759-91bb-bd0d1d9c26a5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:32.131541 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3260df24-f604-4759-91bb-bd0d1d9c26a5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:32.232626 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-3260df24-f604-4759-91bb-bd0d1d9c26a5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 28607 microversion: 2.1 time: 0.114665 Jan 24 22:29:32.233419 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 158/313] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:32 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 28607 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:32.347992 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3c2018d6-fe30-4f40-bd73-d90a705d32f1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:32.350187 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3c2018d6-fe30-4f40-bd73-d90a705d32f1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:32.357724 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3c2018d6-fe30-4f40-bd73-d90a705d32f1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:32.358170 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3c2018d6-fe30-4f40-bd73-d90a705d32f1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:32.358950 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3c2018d6-fe30-4f40-bd73-d90a705d32f1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:32.360056 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3c2018d6-fe30-4f40-bd73-d90a705d32f1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:32.487766 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3c2018d6-fe30-4f40-bd73-d90a705d32f1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 25702 microversion: 2.20 time: 0.146256 Jan 24 22:29:32.489078 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 156/314] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:32 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 25702 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:32.568311 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-706a7886-336f-4427-b270-cf75adc016ca tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95dfca43-4d19-42b7-95e6-6745d8f0c3c7"}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:32.569462 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-706a7886-336f-4427-b270-cf75adc016ca tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:32.576178 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-706a7886-336f-4427-b270-cf75adc016ca tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:32.576621 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-706a7886-336f-4427-b270-cf75adc016ca tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:32.577425 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-706a7886-336f-4427-b270-cf75adc016ca tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:32.577854 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-706a7886-336f-4427-b270-cf75adc016ca tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:32.856082 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-706a7886-336f-4427-b270-cf75adc016ca tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "POST /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291209 Jan 24 22:29:32.856666 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 159/315] 10.222.0.84 () {60 vars in 1322 bytes} [Mon Jan 24 22:29:32 2022] POST /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:32.908632 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-0dbe1a9d-8c3a-4265-8352-788cc4ee24a5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:32.910122 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-0dbe1a9d-8c3a-4265-8352-788cc4ee24a5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:32.916955 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0dbe1a9d-8c3a-4265-8352-788cc4ee24a5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:32.917436 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0dbe1a9d-8c3a-4265-8352-788cc4ee24a5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:32.918553 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0dbe1a9d-8c3a-4265-8352-788cc4ee24a5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:32.919065 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0dbe1a9d-8c3a-4265-8352-788cc4ee24a5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:33.069361 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-0dbe1a9d-8c3a-4265-8352-788cc4ee24a5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:33.076938 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-0dbe1a9d-8c3a-4265-8352-788cc4ee24a5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.173936 Jan 24 22:29:33.077534 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 157/316] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:32 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:33.245677 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-38c34ce3-0b63-46d8-94a1-184f6afbd218 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:33.246778 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-38c34ce3-0b63-46d8-94a1-184f6afbd218 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:33.253298 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-38c34ce3-0b63-46d8-94a1-184f6afbd218 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:33.253744 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-38c34ce3-0b63-46d8-94a1-184f6afbd218 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:33.254516 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-38c34ce3-0b63-46d8-94a1-184f6afbd218 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:33.254944 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-38c34ce3-0b63-46d8-94a1-184f6afbd218 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:33.379036 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-38c34ce3-0b63-46d8-94a1-184f6afbd218 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 28607 microversion: 2.1 time: 0.137744 Jan 24 22:29:33.379802 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 160/317] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:33 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 28607 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:33.504811 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-5ee35868-71f5-4d68-81ab-6c0ee08b8be1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:33.506433 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-5ee35868-71f5-4d68-81ab-6c0ee08b8be1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:33.515590 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5ee35868-71f5-4d68-81ab-6c0ee08b8be1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:33.516083 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5ee35868-71f5-4d68-81ab-6c0ee08b8be1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:33.516860 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5ee35868-71f5-4d68-81ab-6c0ee08b8be1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:33.517312 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5ee35868-71f5-4d68-81ab-6c0ee08b8be1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:33.672526 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-5ee35868-71f5-4d68-81ab-6c0ee08b8be1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 26380 microversion: 2.20 time: 0.175123 Jan 24 22:29:33.673426 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 158/318] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:33 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 26380 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:34.094031 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0a194b10-7a05-408e-9f1d-5e18560d6956 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:34.094883 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0a194b10-7a05-408e-9f1d-5e18560d6956 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:34.101954 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0a194b10-7a05-408e-9f1d-5e18560d6956 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:34.102396 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0a194b10-7a05-408e-9f1d-5e18560d6956 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:34.103142 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0a194b10-7a05-408e-9f1d-5e18560d6956 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:34.103617 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0a194b10-7a05-408e-9f1d-5e18560d6956 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:34.245521 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0a194b10-7a05-408e-9f1d-5e18560d6956 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:34.253114 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0a194b10-7a05-408e-9f1d-5e18560d6956 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.163518 Jan 24 22:29:34.253676 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 161/319] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:34 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:34.392588 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-add5ef30-9988-4bc7-babf-60a798301cb9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:34.393584 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-add5ef30-9988-4bc7-babf-60a798301cb9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:34.400646 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-add5ef30-9988-4bc7-babf-60a798301cb9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:34.401119 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-add5ef30-9988-4bc7-babf-60a798301cb9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:34.401926 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-add5ef30-9988-4bc7-babf-60a798301cb9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:34.402354 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-add5ef30-9988-4bc7-babf-60a798301cb9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:34.524722 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-add5ef30-9988-4bc7-babf-60a798301cb9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 28607 microversion: 2.1 time: 0.136137 Jan 24 22:29:34.525707 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 159/320] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:34 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 28607 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:29:34.684139 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6978170a-8a31-4c03-9a0b-10edfddeaa75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:34.685099 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6978170a-8a31-4c03-9a0b-10edfddeaa75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:34.691797 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6978170a-8a31-4c03-9a0b-10edfddeaa75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:34.692243 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6978170a-8a31-4c03-9a0b-10edfddeaa75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:34.693037 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6978170a-8a31-4c03-9a0b-10edfddeaa75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:34.693480 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6978170a-8a31-4c03-9a0b-10edfddeaa75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:34.828712 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6978170a-8a31-4c03-9a0b-10edfddeaa75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 26980 microversion: 2.20 time: 0.147961 Jan 24 22:29:34.830175 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 162/321] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:34 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 26980 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:35.271536 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-f08967d7-aa3e-4413-8d6f-ed33cb05f738 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:35.272392 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-f08967d7-aa3e-4413-8d6f-ed33cb05f738 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:35.281060 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f08967d7-aa3e-4413-8d6f-ed33cb05f738 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:35.281537 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f08967d7-aa3e-4413-8d6f-ed33cb05f738 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:35.282562 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f08967d7-aa3e-4413-8d6f-ed33cb05f738 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:35.283235 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f08967d7-aa3e-4413-8d6f-ed33cb05f738 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:35.429168 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-f08967d7-aa3e-4413-8d6f-ed33cb05f738 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:35.438121 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-f08967d7-aa3e-4413-8d6f-ed33cb05f738 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.171299 Jan 24 22:29:35.438881 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 160/322] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:35 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:35.539053 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-7fe5583c-cd55-4836-b259-12920f09c5ab tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:35.540600 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-7fe5583c-cd55-4836-b259-12920f09c5ab tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:35.548910 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7fe5583c-cd55-4836-b259-12920f09c5ab tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:35.549432 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7fe5583c-cd55-4836-b259-12920f09c5ab tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:35.550225 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7fe5583c-cd55-4836-b259-12920f09c5ab tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:35.550651 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7fe5583c-cd55-4836-b259-12920f09c5ab tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:35.689762 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-7fe5583c-cd55-4836-b259-12920f09c5ab tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 29905 microversion: 2.1 time: 0.154721 Jan 24 22:29:35.694204 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 163/323] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:35 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 29905 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:35.843945 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a256f86d-cf99-4ed0-9b76-67078162cd90 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:35.844861 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a256f86d-cf99-4ed0-9b76-67078162cd90 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:35.851309 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a256f86d-cf99-4ed0-9b76-67078162cd90 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:35.851671 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a256f86d-cf99-4ed0-9b76-67078162cd90 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:35.852514 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a256f86d-cf99-4ed0-9b76-67078162cd90 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:35.852863 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a256f86d-cf99-4ed0-9b76-67078162cd90 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:35.982839 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a256f86d-cf99-4ed0-9b76-67078162cd90 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 27407 microversion: 2.20 time: 0.142550 Jan 24 22:29:35.983499 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 161/324] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:35 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 27407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:36.456156 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-5a38c4c5-544a-4a7c-b741-33177f2fe614 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:36.456865 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-5a38c4c5-544a-4a7c-b741-33177f2fe614 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:36.463743 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5a38c4c5-544a-4a7c-b741-33177f2fe614 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:36.464187 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5a38c4c5-544a-4a7c-b741-33177f2fe614 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:36.464966 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5a38c4c5-544a-4a7c-b741-33177f2fe614 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:36.465420 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5a38c4c5-544a-4a7c-b741-33177f2fe614 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:36.612040 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5a38c4c5-544a-4a7c-b741-33177f2fe614 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:36.627553 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-5a38c4c5-544a-4a7c-b741-33177f2fe614 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.175194 Jan 24 22:29:36.628123 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 164/325] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:36 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:36.702743 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8bfce389-1360-4d8d-b9d4-5d5188158121 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:36.704041 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8bfce389-1360-4d8d-b9d4-5d5188158121 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:36.713737 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8bfce389-1360-4d8d-b9d4-5d5188158121 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:36.714581 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8bfce389-1360-4d8d-b9d4-5d5188158121 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:36.715537 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8bfce389-1360-4d8d-b9d4-5d5188158121 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:36.716169 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8bfce389-1360-4d8d-b9d4-5d5188158121 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:36.854316 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8bfce389-1360-4d8d-b9d4-5d5188158121 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 31132 microversion: 2.1 time: 0.156455 Jan 24 22:29:36.856033 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 162/326] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:36 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 31132 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:36.994330 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c31fe506-de65-44ed-83a0-559dab101534 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:36.995471 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c31fe506-de65-44ed-83a0-559dab101534 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:37.001838 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c31fe506-de65-44ed-83a0-559dab101534 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:37.002577 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c31fe506-de65-44ed-83a0-559dab101534 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:37.003403 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c31fe506-de65-44ed-83a0-559dab101534 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:37.004041 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c31fe506-de65-44ed-83a0-559dab101534 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:37.126887 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c31fe506-de65-44ed-83a0-559dab101534 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 27653 microversion: 2.20 time: 0.135671 Jan 24 22:29:37.128103 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 165/327] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:36 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 27653 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:29:37.645367 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6015670d-9740-4238-8e9d-87add1f41c94 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:37.646274 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6015670d-9740-4238-8e9d-87add1f41c94 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:37.654920 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6015670d-9740-4238-8e9d-87add1f41c94 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:37.655843 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6015670d-9740-4238-8e9d-87add1f41c94 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:37.656834 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6015670d-9740-4238-8e9d-87add1f41c94 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:37.657388 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6015670d-9740-4238-8e9d-87add1f41c94 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:37.867626 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-79067938-6336-428b-aea0-3741a36c155c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:37.868752 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-79067938-6336-428b-aea0-3741a36c155c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:37.876497 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-79067938-6336-428b-aea0-3741a36c155c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:37.877580 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-79067938-6336-428b-aea0-3741a36c155c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:37.878474 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-79067938-6336-428b-aea0-3741a36c155c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:37.879007 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-79067938-6336-428b-aea0-3741a36c155c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:37.893577 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-6015670d-9740-4238-8e9d-87add1f41c94 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:37.901659 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6015670d-9740-4238-8e9d-87add1f41c94 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.260685 Jan 24 22:29:37.911650 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 163/328] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:37 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:38.011905 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-79067938-6336-428b-aea0-3741a36c155c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 35865 microversion: 2.1 time: 0.148341 Jan 24 22:29:38.012890 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 166/329] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:37 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 35865 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:38.140685 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ef4e86e0-156a-4ad9-ad9f-6ec1d239093e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:38.141682 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ef4e86e0-156a-4ad9-ad9f-6ec1d239093e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:38.148627 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ef4e86e0-156a-4ad9-ad9f-6ec1d239093e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:38.149100 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ef4e86e0-156a-4ad9-ad9f-6ec1d239093e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:38.150017 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ef4e86e0-156a-4ad9-ad9f-6ec1d239093e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:38.150445 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ef4e86e0-156a-4ad9-ad9f-6ec1d239093e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:38.284159 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ef4e86e0-156a-4ad9-ad9f-6ec1d239093e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 27886 microversion: 2.20 time: 0.147882 Jan 24 22:29:38.285047 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 164/330] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:38 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 27886 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:29:38.919603 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-673c20c5-3d31-43e4-8d34-7f22eb740c89 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:38.921004 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-673c20c5-3d31-43e4-8d34-7f22eb740c89 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:38.928117 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-673c20c5-3d31-43e4-8d34-7f22eb740c89 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:38.928563 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-673c20c5-3d31-43e4-8d34-7f22eb740c89 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:38.929379 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-673c20c5-3d31-43e4-8d34-7f22eb740c89 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:38.929801 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-673c20c5-3d31-43e4-8d34-7f22eb740c89 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:39.026089 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-87fa1fa4-2b25-47ee-8fcb-2c1b535b4273 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:39.027361 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-87fa1fa4-2b25-47ee-8fcb-2c1b535b4273 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:39.037089 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-87fa1fa4-2b25-47ee-8fcb-2c1b535b4273 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:39.037886 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-87fa1fa4-2b25-47ee-8fcb-2c1b535b4273 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:39.039547 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-87fa1fa4-2b25-47ee-8fcb-2c1b535b4273 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:39.040182 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-87fa1fa4-2b25-47ee-8fcb-2c1b535b4273 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:39.107781 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-673c20c5-3d31-43e4-8d34-7f22eb740c89 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:39.115227 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-673c20c5-3d31-43e4-8d34-7f22eb740c89 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.199901 Jan 24 22:29:39.115787 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 167/331] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:38 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:39.170979 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-87fa1fa4-2b25-47ee-8fcb-2c1b535b4273 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 36584 microversion: 2.1 time: 0.146776 Jan 24 22:29:39.171654 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 165/332] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:39 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 36584 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:39.299902 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-522d3faf-e7e9-4712-a13e-371922fe288c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:39.300770 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-522d3faf-e7e9-4712-a13e-371922fe288c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:39.307069 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-522d3faf-e7e9-4712-a13e-371922fe288c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:39.307615 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-522d3faf-e7e9-4712-a13e-371922fe288c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:39.308405 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-522d3faf-e7e9-4712-a13e-371922fe288c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:39.308864 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-522d3faf-e7e9-4712-a13e-371922fe288c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:39.449341 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-522d3faf-e7e9-4712-a13e-371922fe288c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 28195 microversion: 2.20 time: 0.156235 Jan 24 22:29:39.450213 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 168/333] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:39 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 28195 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:40.131988 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-0afb9f9a-945c-40f4-8983-842d9da5a734 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:40.132677 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-0afb9f9a-945c-40f4-8983-842d9da5a734 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:40.141410 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0afb9f9a-945c-40f4-8983-842d9da5a734 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:40.142089 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0afb9f9a-945c-40f4-8983-842d9da5a734 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:40.143465 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0afb9f9a-945c-40f4-8983-842d9da5a734 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:40.144008 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0afb9f9a-945c-40f4-8983-842d9da5a734 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:40.183369 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-580c2017-e2f6-44f3-a803-b110be445a23 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:40.184439 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-580c2017-e2f6-44f3-a803-b110be445a23 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:40.192194 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-580c2017-e2f6-44f3-a803-b110be445a23 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:40.192864 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-580c2017-e2f6-44f3-a803-b110be445a23 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:40.199766 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-580c2017-e2f6-44f3-a803-b110be445a23 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:40.200099 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-580c2017-e2f6-44f3-a803-b110be445a23 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:40.312959 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-0afb9f9a-945c-40f4-8983-842d9da5a734 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:40.321518 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-0afb9f9a-945c-40f4-8983-842d9da5a734 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.193568 Jan 24 22:29:40.322546 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 166/334] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:40 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:40.362824 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-580c2017-e2f6-44f3-a803-b110be445a23 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 36879 microversion: 2.1 time: 0.183162 Jan 24 22:29:40.363595 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 169/335] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:40 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 36879 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:40.407375 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-19ef4944-6c55-4252-976e-541232238431 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95dfca43-4d19-42b7-95e6-6745d8f0c3c7"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:40.408456 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-19ef4944-6c55-4252-976e-541232238431 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:40.414701 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19ef4944-6c55-4252-976e-541232238431 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:40.415145 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19ef4944-6c55-4252-976e-541232238431 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:40.416156 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19ef4944-6c55-4252-976e-541232238431 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:40.416617 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19ef4944-6c55-4252-976e-541232238431 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:40.462222 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2882f727-e002-40b5-95ff-f2d21b00160b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:40.463216 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2882f727-e002-40b5-95ff-f2d21b00160b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:40.473945 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2882f727-e002-40b5-95ff-f2d21b00160b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:40.474389 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2882f727-e002-40b5-95ff-f2d21b00160b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:40.475349 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2882f727-e002-40b5-95ff-f2d21b00160b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:40.475777 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2882f727-e002-40b5-95ff-f2d21b00160b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:40.500538 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-19ef4944-6c55-4252-976e-541232238431 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] HTTP exception thrown: Invalid volume: volume 95dfca43-4d19-42b7-95e6-6745d8f0c3c7 is already attached to instances: 14a5b58c-493c-46a9-a297-4fd94047866f Jan 24 22:29:40.501498 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-19ef4944-6c55-4252-976e-541232238431 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Returning 400 to user: Invalid volume: volume 95dfca43-4d19-42b7-95e6-6745d8f0c3c7 is already attached to instances: 14a5b58c-493c-46a9-a297-4fd94047866f {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:29:40.502323 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-19ef4944-6c55-4252-976e-541232238431 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "POST /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099163 Jan 24 22:29:40.503200 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 167/336] 10.222.0.84 () {60 vars in 1322 bytes} [Mon Jan 24 22:29:40 2022] POST /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 24 22:29:40.562213 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-fdab495b-1dd2-4f9b-9d8e-a69b94a66a23 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:40.562693 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-fdab495b-1dd2-4f9b-9d8e-a69b94a66a23 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:40.569086 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fdab495b-1dd2-4f9b-9d8e-a69b94a66a23 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:40.569521 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fdab495b-1dd2-4f9b-9d8e-a69b94a66a23 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:40.570304 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fdab495b-1dd2-4f9b-9d8e-a69b94a66a23 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:40.570723 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fdab495b-1dd2-4f9b-9d8e-a69b94a66a23 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:40.621524 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2882f727-e002-40b5-95ff-f2d21b00160b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 28197 microversion: 2.20 time: 0.163025 Jan 24 22:29:40.626531 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 170/337] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:40 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 28197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:29:40.701893 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.objects.instance [None req-fdab495b-1dd2-4f9b-9d8e-a69b94a66a23 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lazy-loading 'services' on Instance uuid 14a5b58c-493c-46a9-a297-4fd94047866f {{(pid=116466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:29:40.826029 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-fdab495b-1dd2-4f9b-9d8e-a69b94a66a23 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "DELETE /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f/os-volume_attachments/95dfca43-4d19-42b7-95e6-6745d8f0c3c7" status: 202 len: 0 microversion: 2.1 time: 0.267613 Jan 24 22:29:40.826593 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 168/338] 10.222.0.84 () {58 vars in 1415 bytes} [Mon Jan 24 22:29:40 2022] DELETE /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f/os-volume_attachments/95dfca43-4d19-42b7-95e6-6745d8f0c3c7 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:29:40.836061 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-dc6cd68c-b8f9-4cc5-81f8-644d314196d6 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:40.837659 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-dc6cd68c-b8f9-4cc5-81f8-644d314196d6 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:40.846492 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dc6cd68c-b8f9-4cc5-81f8-644d314196d6 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:40.847034 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dc6cd68c-b8f9-4cc5-81f8-644d314196d6 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:40.847823 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dc6cd68c-b8f9-4cc5-81f8-644d314196d6 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:40.848512 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dc6cd68c-b8f9-4cc5-81f8-644d314196d6 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:40.879596 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-dc6cd68c-b8f9-4cc5-81f8-644d314196d6 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048144 Jan 24 22:29:40.880163 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 171/339] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:29:40 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:41.341288 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2fa5154a-90f3-417f-85e2-5676a665d13d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:41.342161 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2fa5154a-90f3-417f-85e2-5676a665d13d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:41.350388 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2fa5154a-90f3-417f-85e2-5676a665d13d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:41.351238 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2fa5154a-90f3-417f-85e2-5676a665d13d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:41.352150 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2fa5154a-90f3-417f-85e2-5676a665d13d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:41.352584 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2fa5154a-90f3-417f-85e2-5676a665d13d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:41.375752 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-dca1d965-a45b-4a40-bfb6-3a8662685175 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:41.376691 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-dca1d965-a45b-4a40-bfb6-3a8662685175 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:41.382904 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dca1d965-a45b-4a40-bfb6-3a8662685175 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:41.383345 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dca1d965-a45b-4a40-bfb6-3a8662685175 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:41.384108 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dca1d965-a45b-4a40-bfb6-3a8662685175 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:41.384539 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dca1d965-a45b-4a40-bfb6-3a8662685175 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:41.490524 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-2fa5154a-90f3-417f-85e2-5676a665d13d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:41.498461 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2fa5154a-90f3-417f-85e2-5676a665d13d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.162765 Jan 24 22:29:41.499015 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 169/340] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:41 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:41.521459 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-dca1d965-a45b-4a40-bfb6-3a8662685175 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 37151 microversion: 2.1 time: 0.149937 Jan 24 22:29:41.522068 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 172/341] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:41 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 37151 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:41.634290 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8f08354c-fe85-466f-8fa2-0ce6a9469393 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:41.635335 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8f08354c-fe85-466f-8fa2-0ce6a9469393 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:41.642241 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8f08354c-fe85-466f-8fa2-0ce6a9469393 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:41.642693 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8f08354c-fe85-466f-8fa2-0ce6a9469393 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:41.643486 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8f08354c-fe85-466f-8fa2-0ce6a9469393 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:41.643910 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8f08354c-fe85-466f-8fa2-0ce6a9469393 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:41.752249 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8f08354c-fe85-466f-8fa2-0ce6a9469393 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 28197 microversion: 2.20 time: 0.121504 Jan 24 22:29:41.752911 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 170/342] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:41 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 28197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:41.835330 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0a88b74d-7891-46a0-8493-3dd2e1da9cfd tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2124058046", "imageRef": "4fe12948-6887-4759-900b-f3ee39409e75", "flavorRef": "452", "networks": [{"uuid": "10de36a5-6511-4593-99b8-3e13068c9c6a"}]}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:41.892762 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8abed7e2-8d58-4f6e-a8a0-6747fba88b63 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:41.893310 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.network.neutron [None req-0a88b74d-7891-46a0-8493-3dd2e1da9cfd tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] validate_networks() for [('10de36a5-6511-4593-99b8-3e13068c9c6a', None, None, None, None, None)] {{(pid=116467) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:29:41.893906 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8abed7e2-8d58-4f6e-a8a0-6747fba88b63 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:41.901932 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8abed7e2-8d58-4f6e-a8a0-6747fba88b63 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:41.902482 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8abed7e2-8d58-4f6e-a8a0-6747fba88b63 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:41.903383 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8abed7e2-8d58-4f6e-a8a0-6747fba88b63 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:41.903876 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8abed7e2-8d58-4f6e-a8a0-6747fba88b63 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:41.935658 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8abed7e2-8d58-4f6e-a8a0-6747fba88b63 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047901 Jan 24 22:29:41.936342 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 171/343] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:29:41 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:42.253632 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-0a88b74d-7891-46a0-8493-3dd2e1da9cfd tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Flavor limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:29:42.254057 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-0a88b74d-7891-46a0-8493-3dd2e1da9cfd tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Image limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:29:42.254529 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-0a88b74d-7891-46a0-8493-3dd2e1da9cfd tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Flavor pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:29:42.254969 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-0a88b74d-7891-46a0-8493-3dd2e1da9cfd tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Image pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:29:42.255372 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-0a88b74d-7891-46a0-8493-3dd2e1da9cfd tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:29:42.267511 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0a88b74d-7891-46a0-8493-3dd2e1da9cfd tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:42.267960 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0a88b74d-7891-46a0-8493-3dd2e1da9cfd tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:42.268772 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0a88b74d-7891-46a0-8493-3dd2e1da9cfd tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:42.269245 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0a88b74d-7891-46a0-8493-3dd2e1da9cfd tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:42.286989 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-0a88b74d-7891-46a0-8493-3dd2e1da9cfd tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Getting quotas for project f745f8e89f0b47f7a49e565becce2c16. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:29:42.292010 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-0a88b74d-7891-46a0-8493-3dd2e1da9cfd tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Getting quotas for user 763ba0faf8324e039936fc2086ee6d54 and project f745f8e89f0b47f7a49e565becce2c16. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:29:42.304085 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0a88b74d-7891-46a0-8493-3dd2e1da9cfd tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Going to run 1 instances... {{(pid=116467) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:29:42.306633 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0a88b74d-7891-46a0-8493-3dd2e1da9cfd tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fe12948-6887-4759-900b-f3ee39409e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:29:42.358743 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0a88b74d-7891-46a0-8493-3dd2e1da9cfd tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527486 Jan 24 22:29:42.359420 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 173/344] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:29:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 24 22:29:42.369749 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-217f7d17-cfe4-41cc-8556-a53769641f76 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:42.370712 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-217f7d17-cfe4-41cc-8556-a53769641f76 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:42.426047 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-217f7d17-cfe4-41cc-8556-a53769641f76 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:42.432576 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-217f7d17-cfe4-41cc-8556-a53769641f76 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 200 len: 1214 microversion: 2.1 time: 0.066795 Jan 24 22:29:42.433356 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 172/345] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:42 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:42.516199 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-aff64a78-0eee-439d-82c8-e902e5df4b0d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:42.516796 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-aff64a78-0eee-439d-82c8-e902e5df4b0d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:42.523569 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-aff64a78-0eee-439d-82c8-e902e5df4b0d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:42.524008 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-aff64a78-0eee-439d-82c8-e902e5df4b0d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:42.524961 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-aff64a78-0eee-439d-82c8-e902e5df4b0d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:42.525506 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-aff64a78-0eee-439d-82c8-e902e5df4b0d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:42.535267 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-86b0f9ad-3250-43f0-b472-f93c602af7df tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:42.536248 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-86b0f9ad-3250-43f0-b472-f93c602af7df tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:42.544162 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-86b0f9ad-3250-43f0-b472-f93c602af7df tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:42.544616 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-86b0f9ad-3250-43f0-b472-f93c602af7df tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:42.545448 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-86b0f9ad-3250-43f0-b472-f93c602af7df tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:42.545912 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-86b0f9ad-3250-43f0-b472-f93c602af7df tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:42.663098 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-86b0f9ad-3250-43f0-b472-f93c602af7df tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 37714 microversion: 2.1 time: 0.129914 Jan 24 22:29:42.664331 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 173/346] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:42 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 37714 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:42.690948 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-aff64a78-0eee-439d-82c8-e902e5df4b0d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:42.698660 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-aff64a78-0eee-439d-82c8-e902e5df4b0d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.187218 Jan 24 22:29:42.699219 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 174/347] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:42 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:42.765030 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-f5af24ae-6cdf-4d2e-a816-ca1cb4fbbd1d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:42.765949 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-f5af24ae-6cdf-4d2e-a816-ca1cb4fbbd1d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:42.773055 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f5af24ae-6cdf-4d2e-a816-ca1cb4fbbd1d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:42.773520 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f5af24ae-6cdf-4d2e-a816-ca1cb4fbbd1d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:42.774285 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f5af24ae-6cdf-4d2e-a816-ca1cb4fbbd1d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:42.774709 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f5af24ae-6cdf-4d2e-a816-ca1cb4fbbd1d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:42.891021 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-f5af24ae-6cdf-4d2e-a816-ca1cb4fbbd1d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 28197 microversion: 2.20 time: 0.130526 Jan 24 22:29:42.891677 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 174/348] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:42 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 28197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:42.947592 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-8e6ce510-1ac4-4c59-9782-d4283e7c9a14 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:42.948586 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-8e6ce510-1ac4-4c59-9782-d4283e7c9a14 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:42.955465 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8e6ce510-1ac4-4c59-9782-d4283e7c9a14 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:42.956003 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8e6ce510-1ac4-4c59-9782-d4283e7c9a14 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:42.956807 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8e6ce510-1ac4-4c59-9782-d4283e7c9a14 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:42.957268 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8e6ce510-1ac4-4c59-9782-d4283e7c9a14 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:42.986842 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-8e6ce510-1ac4-4c59-9782-d4283e7c9a14 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043183 Jan 24 22:29:42.987411 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 175/349] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:29:42 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 22:29:43.138889 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b5947916-b871-42fe-a417-42139e24511f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-176246618", "imageRef": "4fe12948-6887-4759-900b-f3ee39409e75", "flavorRef": "452", "networks": [{"uuid": "e8ede52f-f77b-4695-9cf8-08051f1c017e"}]}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:43.201268 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.network.neutron [None req-b5947916-b871-42fe-a417-42139e24511f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] validate_networks() for [('e8ede52f-f77b-4695-9cf8-08051f1c017e', None, None, None, None, None)] {{(pid=116466) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:29:43.450636 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9dc2750b-d71e-4957-ac56-ee0585943b6d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:43.450935 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9dc2750b-d71e-4957-ac56-ee0585943b6d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:43.457563 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9dc2750b-d71e-4957-ac56-ee0585943b6d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:43.458007 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9dc2750b-d71e-4957-ac56-ee0585943b6d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:43.458781 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9dc2750b-d71e-4957-ac56-ee0585943b6d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:43.459185 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9dc2750b-d71e-4957-ac56-ee0585943b6d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:43.535321 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-9dc2750b-d71e-4957-ac56-ee0585943b6d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:43.543363 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9dc2750b-d71e-4957-ac56-ee0585943b6d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 200 len: 1266 microversion: 2.1 time: 0.097170 Jan 24 22:29:43.553688 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 176/350] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:43 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:43.600575 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-b5947916-b871-42fe-a417-42139e24511f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Flavor limits 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:29:43.601102 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-b5947916-b871-42fe-a417-42139e24511f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Image limits 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:29:43.601522 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-b5947916-b871-42fe-a417-42139e24511f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Flavor pref 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:29:43.601994 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-b5947916-b871-42fe-a417-42139e24511f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Image pref 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:29:43.602402 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-b5947916-b871-42fe-a417-42139e24511f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:29:43.614420 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b5947916-b871-42fe-a417-42139e24511f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:43.614870 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b5947916-b871-42fe-a417-42139e24511f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:43.615689 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b5947916-b871-42fe-a417-42139e24511f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:43.616126 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b5947916-b871-42fe-a417-42139e24511f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:43.633412 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-b5947916-b871-42fe-a417-42139e24511f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Getting quotas for project a78218846bb84713b4c02d9f95a25250. Resources: {'cores', 'instances', 'ram'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:29:43.637439 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-b5947916-b871-42fe-a417-42139e24511f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Getting quotas for user a0f51c8d0b8c4cc5ab76dae765c1b1c9 and project a78218846bb84713b4c02d9f95a25250. Resources: {'cores', 'instances', 'ram'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:29:43.650498 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b5947916-b871-42fe-a417-42139e24511f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Going to run 1 instances... {{(pid=116466) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:29:43.653520 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b5947916-b871-42fe-a417-42139e24511f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fe12948-6887-4759-900b-f3ee39409e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:29:43.677583 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-21033ce7-93a4-4299-a1c5-04fdb776b78c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:43.678530 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-21033ce7-93a4-4299-a1c5-04fdb776b78c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:43.690777 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-21033ce7-93a4-4299-a1c5-04fdb776b78c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:43.691723 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-21033ce7-93a4-4299-a1c5-04fdb776b78c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:43.692696 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-21033ce7-93a4-4299-a1c5-04fdb776b78c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:43.693421 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-21033ce7-93a4-4299-a1c5-04fdb776b78c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:43.718508 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b5947916-b871-42fe-a417-42139e24511f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585515 Jan 24 22:29:43.724145 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 175/351] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:29:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 24 22:29:43.727845 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8b4f07a7-d899-4b85-bd4c-629748ae4f38 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:43.728554 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8b4f07a7-d899-4b85-bd4c-629748ae4f38 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:43.735868 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8b4f07a7-d899-4b85-bd4c-629748ae4f38 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:43.736596 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8b4f07a7-d899-4b85-bd4c-629748ae4f38 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:43.737421 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8b4f07a7-d899-4b85-bd4c-629748ae4f38 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:43.738008 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8b4f07a7-d899-4b85-bd4c-629748ae4f38 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:43.843351 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-21033ce7-93a4-4299-a1c5-04fdb776b78c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 38093 microversion: 2.1 time: 0.169323 Jan 24 22:29:43.851116 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 177/352] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:43 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 38093 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:43.858848 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a79f2c27-df60-4b43-9144-3853112b6ba8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:43.859545 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a79f2c27-df60-4b43-9144-3853112b6ba8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:43.922151 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-8b4f07a7-d899-4b85-bd4c-629748ae4f38 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:43.940505 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8b4f07a7-d899-4b85-bd4c-629748ae4f38 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.218244 Jan 24 22:29:43.950098 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 176/353] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:43 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:43.950098 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3351b1c6-9f4f-475e-81fe-743d5ede5b39 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:43.950098 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3351b1c6-9f4f-475e-81fe-743d5ede5b39 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:43.950629 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a79f2c27-df60-4b43-9144-3853112b6ba8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:43.956825 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3351b1c6-9f4f-475e-81fe-743d5ede5b39 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:43.957475 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3351b1c6-9f4f-475e-81fe-743d5ede5b39 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:43.958342 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3351b1c6-9f4f-475e-81fe-743d5ede5b39 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:43.959349 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3351b1c6-9f4f-475e-81fe-743d5ede5b39 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:43.963232 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a79f2c27-df60-4b43-9144-3853112b6ba8 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1217 microversion: 2.1 time: 0.108915 Jan 24 22:29:43.966835 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 178/354] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:43 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1217 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:44.111857 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3351b1c6-9f4f-475e-81fe-743d5ede5b39 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 28487 microversion: 2.20 time: 0.167422 Jan 24 22:29:44.118273 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 177/355] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:43 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 28487 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:44.561478 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1ae1d0c5-c3e0-4d41-8946-c870d882d03f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:44.562069 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1ae1d0c5-c3e0-4d41-8946-c870d882d03f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:44.568918 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1ae1d0c5-c3e0-4d41-8946-c870d882d03f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:44.569402 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1ae1d0c5-c3e0-4d41-8946-c870d882d03f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:44.570184 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1ae1d0c5-c3e0-4d41-8946-c870d882d03f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:44.570605 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1ae1d0c5-c3e0-4d41-8946-c870d882d03f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:44.700169 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1ae1d0c5-c3e0-4d41-8946-c870d882d03f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:44.708014 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1ae1d0c5-c3e0-4d41-8946-c870d882d03f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 200 len: 1314 microversion: 2.1 time: 0.150589 Jan 24 22:29:44.708579 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 179/356] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:44 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:44.866009 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-5c9a8098-d702-4dcd-8837-b607e919d8c9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:44.873613 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-5c9a8098-d702-4dcd-8837-b607e919d8c9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:44.881355 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5c9a8098-d702-4dcd-8837-b607e919d8c9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:44.881799 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5c9a8098-d702-4dcd-8837-b607e919d8c9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:44.893743 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5c9a8098-d702-4dcd-8837-b607e919d8c9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:44.894522 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5c9a8098-d702-4dcd-8837-b607e919d8c9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:44.958091 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2d5f2b2c-e923-4c32-9962-15e492228258 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:44.958695 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2d5f2b2c-e923-4c32-9962-15e492228258 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:44.966615 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2d5f2b2c-e923-4c32-9962-15e492228258 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:44.967084 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2d5f2b2c-e923-4c32-9962-15e492228258 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:44.967880 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2d5f2b2c-e923-4c32-9962-15e492228258 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:44.968313 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2d5f2b2c-e923-4c32-9962-15e492228258 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:45.063107 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-5c9a8098-d702-4dcd-8837-b607e919d8c9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 38093 microversion: 2.1 time: 0.207211 Jan 24 22:29:45.064077 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 178/357] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:44 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 38093 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:45.071317 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-fde61695-05cd-461a-a46a-dc0883019630 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:45.072302 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-fde61695-05cd-461a-a46a-dc0883019630 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:45.090542 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fde61695-05cd-461a-a46a-dc0883019630 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:45.091220 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fde61695-05cd-461a-a46a-dc0883019630 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:45.092384 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fde61695-05cd-461a-a46a-dc0883019630 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:45.093006 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fde61695-05cd-461a-a46a-dc0883019630 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:45.182659 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-fde61695-05cd-461a-a46a-dc0883019630 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:45.187334 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2d5f2b2c-e923-4c32-9962-15e492228258 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:45.191347 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-fde61695-05cd-461a-a46a-dc0883019630 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1287 microversion: 2.1 time: 0.125755 Jan 24 22:29:45.192655 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 179/358] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:45 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1287 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:45.195593 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2d5f2b2c-e923-4c32-9962-15e492228258 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.241386 Jan 24 22:29:45.196158 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 180/359] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:44 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:45.205641 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-712dc309-ae3e-4efe-b0e1-fdcef8b5eeee tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:45.210135 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-8c6baa6d-71ac-4f53-8679-2d486c145bb0 req-9b580463-26c3-493b-8c60-a966032f06d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9febabf2-03a2-48f9-ab7d-b6648e470cb4", "tag": "43457efa-6a2a-438a-bc24-799ffc778296"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:45.212156 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:29:45.212156 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:29:45.213564 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-712dc309-ae3e-4efe-b0e1-fdcef8b5eeee tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:45.220178 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-8c6baa6d-71ac-4f53-8679-2d486c145bb0 req-9b580463-26c3-493b-8c60-a966032f06d3 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:45.220741 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-8c6baa6d-71ac-4f53-8679-2d486c145bb0 req-9b580463-26c3-493b-8c60-a966032f06d3 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:45.226210 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-712dc309-ae3e-4efe-b0e1-fdcef8b5eeee tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:45.226741 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-712dc309-ae3e-4efe-b0e1-fdcef8b5eeee tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:45.227601 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-712dc309-ae3e-4efe-b0e1-fdcef8b5eeee tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:45.228121 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-712dc309-ae3e-4efe-b0e1-fdcef8b5eeee tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:45.234614 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-8c6baa6d-71ac-4f53-8679-2d486c145bb0 req-9b580463-26c3-493b-8c60-a966032f06d3 service nova] Creating event network-changed:43457efa-6a2a-438a-bc24-799ffc778296 for instance 9febabf2-03a2-48f9-ab7d-b6648e470cb4 on hv-cinder-81322 Jan 24 22:29:45.240092 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-8c6baa6d-71ac-4f53-8679-2d486c145bb0 req-9b580463-26c3-493b-8c60-a966032f06d3 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045215 Jan 24 22:29:45.240784 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 180/360] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:45.443899 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-712dc309-ae3e-4efe-b0e1-fdcef8b5eeee tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 28538 microversion: 2.20 time: 0.245638 Jan 24 22:29:45.444468 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 181/361] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:45 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 28538 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:45.726538 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c35e5368-78ae-4841-87cd-986cfa813096 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:45.727237 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c35e5368-78ae-4841-87cd-986cfa813096 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:45.733858 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c35e5368-78ae-4841-87cd-986cfa813096 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:45.734293 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c35e5368-78ae-4841-87cd-986cfa813096 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:45.735185 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c35e5368-78ae-4841-87cd-986cfa813096 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:45.735678 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c35e5368-78ae-4841-87cd-986cfa813096 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:45.873888 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c35e5368-78ae-4841-87cd-986cfa813096 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:45.881686 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c35e5368-78ae-4841-87cd-986cfa813096 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 200 len: 1314 microversion: 2.1 time: 0.159612 Jan 24 22:29:45.882358 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 181/362] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:45 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:46.076959 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-10027f12-2dab-4dff-a153-a576a69791f1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:46.077987 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-10027f12-2dab-4dff-a153-a576a69791f1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:46.084736 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-10027f12-2dab-4dff-a153-a576a69791f1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:46.085210 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-10027f12-2dab-4dff-a153-a576a69791f1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:46.085970 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-10027f12-2dab-4dff-a153-a576a69791f1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:46.086409 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-10027f12-2dab-4dff-a153-a576a69791f1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:46.210127 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-10027f12-2dab-4dff-a153-a576a69791f1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 38093 microversion: 2.1 time: 0.137715 Jan 24 22:29:46.210830 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-00a82133-b0ba-4dcb-8b10-13934e54d9bf tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:46.211778 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-00a82133-b0ba-4dcb-8b10-13934e54d9bf tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:46.216426 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 182/363] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:46 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 38093 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:46.220781 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-00a82133-b0ba-4dcb-8b10-13934e54d9bf tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:46.221432 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-00a82133-b0ba-4dcb-8b10-13934e54d9bf tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:46.222517 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-00a82133-b0ba-4dcb-8b10-13934e54d9bf tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:46.223216 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-00a82133-b0ba-4dcb-8b10-13934e54d9bf tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:46.223566 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c4a3aa00-116c-4636-badd-7d1665cd334a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:46.224441 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c4a3aa00-116c-4636-badd-7d1665cd334a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:46.237539 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c4a3aa00-116c-4636-badd-7d1665cd334a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:46.238398 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c4a3aa00-116c-4636-badd-7d1665cd334a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:46.239537 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c4a3aa00-116c-4636-badd-7d1665cd334a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:46.240426 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c4a3aa00-116c-4636-badd-7d1665cd334a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:46.440050 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-00a82133-b0ba-4dcb-8b10-13934e54d9bf tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:46.447805 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-00a82133-b0ba-4dcb-8b10-13934e54d9bf tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1317 microversion: 2.1 time: 0.242113 Jan 24 22:29:46.448355 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 182/364] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:46 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:46.463420 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-be8b5aa9-a5c7-4575-958f-0a2063c73698 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:46.464023 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-be8b5aa9-a5c7-4575-958f-0a2063c73698 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:46.471175 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-be8b5aa9-a5c7-4575-958f-0a2063c73698 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:46.471710 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-be8b5aa9-a5c7-4575-958f-0a2063c73698 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:46.472627 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-be8b5aa9-a5c7-4575-958f-0a2063c73698 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:46.473155 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-be8b5aa9-a5c7-4575-958f-0a2063c73698 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:46.475643 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-c4a3aa00-116c-4636-badd-7d1665cd334a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:46.483783 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c4a3aa00-116c-4636-badd-7d1665cd334a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.265170 Jan 24 22:29:46.484670 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 183/365] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:46 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:46.608395 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-be8b5aa9-a5c7-4575-958f-0a2063c73698 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 28655 microversion: 2.20 time: 0.153622 Jan 24 22:29:46.608954 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 183/366] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:46 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 28655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:46.899893 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c448a771-4e4e-4679-87be-98a16684a770 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:46.900416 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c448a771-4e4e-4679-87be-98a16684a770 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:46.908241 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c448a771-4e4e-4679-87be-98a16684a770 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:46.908683 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c448a771-4e4e-4679-87be-98a16684a770 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:46.909506 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c448a771-4e4e-4679-87be-98a16684a770 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:46.909936 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c448a771-4e4e-4679-87be-98a16684a770 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:47.052217 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-c448a771-4e4e-4679-87be-98a16684a770 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:47.061194 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c448a771-4e4e-4679-87be-98a16684a770 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 200 len: 1314 microversion: 2.1 time: 0.165571 Jan 24 22:29:47.062187 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 184/367] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:46 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:47.224225 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7082a86b-1d3a-4cee-afbf-46072de0ded4 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:47.225275 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7082a86b-1d3a-4cee-afbf-46072de0ded4 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:47.232664 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7082a86b-1d3a-4cee-afbf-46072de0ded4 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:47.233162 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7082a86b-1d3a-4cee-afbf-46072de0ded4 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:47.233946 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7082a86b-1d3a-4cee-afbf-46072de0ded4 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:47.234378 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7082a86b-1d3a-4cee-afbf-46072de0ded4 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:47.299236 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-fe4c308b-f1d9-4fc7-b92e-a8674607bfb6 req-942719ac-70bd-4fee-808b-fac3e3785f9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60a6892a-6bcf-48a9-ba54-e2f6fce165c8", "tag": "d633875b-72bb-44b2-823b-29984eecca9f"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:47.300790 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:29:47.300790 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:29:47.309639 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-fe4c308b-f1d9-4fc7-b92e-a8674607bfb6 req-942719ac-70bd-4fee-808b-fac3e3785f9b service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:47.309918 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-fe4c308b-f1d9-4fc7-b92e-a8674607bfb6 req-942719ac-70bd-4fee-808b-fac3e3785f9b service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:47.332125 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-fe4c308b-f1d9-4fc7-b92e-a8674607bfb6 req-942719ac-70bd-4fee-808b-fac3e3785f9b service nova] Creating event network-changed:d633875b-72bb-44b2-823b-29984eecca9f for instance 60a6892a-6bcf-48a9-ba54-e2f6fce165c8 on hv-cinder-81322 Jan 24 22:29:47.336893 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-fe4c308b-f1d9-4fc7-b92e-a8674607bfb6 req-942719ac-70bd-4fee-808b-fac3e3785f9b service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041418 Jan 24 22:29:47.337494 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 185/368] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:47.349571 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7082a86b-1d3a-4cee-afbf-46072de0ded4 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 38093 microversion: 2.1 time: 0.129302 Jan 24 22:29:47.350216 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 184/369] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:47 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 38093 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:47.468697 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-34fc7783-985f-4231-ab32-32cf39472d74 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:47.469481 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-34fc7783-985f-4231-ab32-32cf39472d74 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:47.476281 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-34fc7783-985f-4231-ab32-32cf39472d74 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:47.476810 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-34fc7783-985f-4231-ab32-32cf39472d74 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:47.477726 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-34fc7783-985f-4231-ab32-32cf39472d74 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:47.478321 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-34fc7783-985f-4231-ab32-32cf39472d74 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:47.502797 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-9019dc0d-bb7d-48db-bac1-bb9c1fd09144 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:47.503485 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-9019dc0d-bb7d-48db-bac1-bb9c1fd09144 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:47.510576 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9019dc0d-bb7d-48db-bac1-bb9c1fd09144 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:47.511034 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9019dc0d-bb7d-48db-bac1-bb9c1fd09144 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:47.511811 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9019dc0d-bb7d-48db-bac1-bb9c1fd09144 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:47.512276 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9019dc0d-bb7d-48db-bac1-bb9c1fd09144 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:47.670707 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-34fc7783-985f-4231-ab32-32cf39472d74 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:47.678192 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-34fc7783-985f-4231-ab32-32cf39472d74 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1317 microversion: 2.1 time: 0.214987 Jan 24 22:29:47.678748 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 186/370] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:47 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:47.686843 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f0f34037-c3fc-422f-8c55-d091c144338b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:47.686843 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-f0f34037-c3fc-422f-8c55-d091c144338b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:47.690315 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f0f34037-c3fc-422f-8c55-d091c144338b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:47.690758 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f0f34037-c3fc-422f-8c55-d091c144338b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:47.691533 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f0f34037-c3fc-422f-8c55-d091c144338b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:47.691923 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f0f34037-c3fc-422f-8c55-d091c144338b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:47.695158 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-9019dc0d-bb7d-48db-bac1-bb9c1fd09144 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:47.703565 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-9019dc0d-bb7d-48db-bac1-bb9c1fd09144 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.204863 Jan 24 22:29:47.704140 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 185/371] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:47 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:47.901811 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-f0f34037-c3fc-422f-8c55-d091c144338b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 28655 microversion: 2.20 time: 0.221603 Jan 24 22:29:47.904042 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 187/372] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:47 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 28655 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:48.078154 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-488d115e-61b2-48e1-95df-5af08f0c00b0 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:48.078855 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-488d115e-61b2-48e1-95df-5af08f0c00b0 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:48.085212 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-488d115e-61b2-48e1-95df-5af08f0c00b0 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:48.085825 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-488d115e-61b2-48e1-95df-5af08f0c00b0 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:48.087036 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-488d115e-61b2-48e1-95df-5af08f0c00b0 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:48.087474 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-488d115e-61b2-48e1-95df-5af08f0c00b0 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:48.236796 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-488d115e-61b2-48e1-95df-5af08f0c00b0 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:48.245509 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-488d115e-61b2-48e1-95df-5af08f0c00b0 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 200 len: 1314 microversion: 2.1 time: 0.171381 Jan 24 22:29:48.248074 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 186/373] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:48 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:48.362080 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-7374694f-14cc-4982-bae2-027252ff8e64 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:48.363092 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-7374694f-14cc-4982-bae2-027252ff8e64 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:48.370745 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7374694f-14cc-4982-bae2-027252ff8e64 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:48.371189 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7374694f-14cc-4982-bae2-027252ff8e64 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:48.372252 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7374694f-14cc-4982-bae2-027252ff8e64 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:48.372680 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7374694f-14cc-4982-bae2-027252ff8e64 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:48.478142 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-7374694f-14cc-4982-bae2-027252ff8e64 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 38093 microversion: 2.1 time: 0.119865 Jan 24 22:29:48.479073 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 188/374] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:48 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 38093 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:48.695070 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ce17f738-a432-4855-b79f-745597b94f83 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:48.695676 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ce17f738-a432-4855-b79f-745597b94f83 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:48.704197 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ce17f738-a432-4855-b79f-745597b94f83 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:48.704765 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ce17f738-a432-4855-b79f-745597b94f83 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:48.706033 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ce17f738-a432-4855-b79f-745597b94f83 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:48.706614 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ce17f738-a432-4855-b79f-745597b94f83 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:48.720245 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-414def25-6132-43ae-8a3a-c371e4dc770d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:48.720951 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-414def25-6132-43ae-8a3a-c371e4dc770d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:48.728945 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-414def25-6132-43ae-8a3a-c371e4dc770d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:48.729386 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-414def25-6132-43ae-8a3a-c371e4dc770d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:48.730417 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-414def25-6132-43ae-8a3a-c371e4dc770d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:48.730841 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-414def25-6132-43ae-8a3a-c371e4dc770d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:48.904078 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ce17f738-a432-4855-b79f-745597b94f83 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:48.911995 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ce17f738-a432-4855-b79f-745597b94f83 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1317 microversion: 2.1 time: 0.220677 Jan 24 22:29:48.913258 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 187/375] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:48 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:48.915894 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-414def25-6132-43ae-8a3a-c371e4dc770d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:48.917724 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-84a2e7ad-fd5a-4348-8a84-cae71cf95710 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:48.918689 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-84a2e7ad-fd5a-4348-8a84-cae71cf95710 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:48.926875 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-414def25-6132-43ae-8a3a-c371e4dc770d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1522 microversion: 2.1 time: 0.210684 Jan 24 22:29:48.927284 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-84a2e7ad-fd5a-4348-8a84-cae71cf95710 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:48.927739 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-84a2e7ad-fd5a-4348-8a84-cae71cf95710 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:48.927862 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 189/376] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:48 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:48.928531 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-84a2e7ad-fd5a-4348-8a84-cae71cf95710 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:48.928960 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-84a2e7ad-fd5a-4348-8a84-cae71cf95710 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:49.054598 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-84a2e7ad-fd5a-4348-8a84-cae71cf95710 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 28655 microversion: 2.20 time: 0.140058 Jan 24 22:29:49.055744 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 188/377] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:48 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 28655 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:49.267569 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3a605e60-b2e4-47c3-8d8f-3d0c2f1a51ab tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:49.268111 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-3a605e60-b2e4-47c3-8d8f-3d0c2f1a51ab tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:49.274945 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3a605e60-b2e4-47c3-8d8f-3d0c2f1a51ab tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:49.275384 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3a605e60-b2e4-47c3-8d8f-3d0c2f1a51ab tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:49.276164 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3a605e60-b2e4-47c3-8d8f-3d0c2f1a51ab tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:49.276589 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3a605e60-b2e4-47c3-8d8f-3d0c2f1a51ab tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:49.416055 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3a605e60-b2e4-47c3-8d8f-3d0c2f1a51ab tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:49.424212 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-3a605e60-b2e4-47c3-8d8f-3d0c2f1a51ab tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 200 len: 1314 microversion: 2.1 time: 0.162065 Jan 24 22:29:49.424798 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 190/378] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:49 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:49.491491 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e1e6643b-8713-4d23-953f-41452a697285 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:49.492495 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e1e6643b-8713-4d23-953f-41452a697285 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:49.499993 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e1e6643b-8713-4d23-953f-41452a697285 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:49.500567 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e1e6643b-8713-4d23-953f-41452a697285 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:49.501414 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e1e6643b-8713-4d23-953f-41452a697285 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:49.501888 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e1e6643b-8713-4d23-953f-41452a697285 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:49.667308 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e1e6643b-8713-4d23-953f-41452a697285 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 38215 microversion: 2.1 time: 0.179939 Jan 24 22:29:49.667966 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 189/379] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:49 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 38215 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:49.937975 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1d87fbd0-2c83-4e97-902d-3c1a733bbe41 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:49.938998 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1d87fbd0-2c83-4e97-902d-3c1a733bbe41 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:49.947391 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2e3e8944-245a-4b2d-b029-679be1ada357 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:49.948607 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2e3e8944-245a-4b2d-b029-679be1ada357 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:49.948813 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1d87fbd0-2c83-4e97-902d-3c1a733bbe41 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:49.949546 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1d87fbd0-2c83-4e97-902d-3c1a733bbe41 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:49.950728 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1d87fbd0-2c83-4e97-902d-3c1a733bbe41 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:49.951398 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1d87fbd0-2c83-4e97-902d-3c1a733bbe41 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:49.956816 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2e3e8944-245a-4b2d-b029-679be1ada357 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:49.957279 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2e3e8944-245a-4b2d-b029-679be1ada357 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:49.958057 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2e3e8944-245a-4b2d-b029-679be1ada357 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:49.958484 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2e3e8944-245a-4b2d-b029-679be1ada357 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:50.152012 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1d87fbd0-2c83-4e97-902d-3c1a733bbe41 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:50.160794 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-2e3e8944-245a-4b2d-b029-679be1ada357 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:50.163282 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1d87fbd0-2c83-4e97-902d-3c1a733bbe41 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1317 microversion: 2.1 time: 0.231887 Jan 24 22:29:50.164080 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 191/380] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:49 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:50.168927 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-92498675-611e-41a7-8b57-9e1003cfc9fc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:50.169919 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-92498675-611e-41a7-8b57-9e1003cfc9fc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:50.178898 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2e3e8944-245a-4b2d-b029-679be1ada357 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1502 microversion: 2.1 time: 0.237532 Jan 24 22:29:50.179435 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-92498675-611e-41a7-8b57-9e1003cfc9fc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:50.180072 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 190/381] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:49 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1502 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:50.180196 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-92498675-611e-41a7-8b57-9e1003cfc9fc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:50.181212 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-92498675-611e-41a7-8b57-9e1003cfc9fc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:50.181976 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-92498675-611e-41a7-8b57-9e1003cfc9fc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:50.198305 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ad94f855-c520-4255-a1dd-6a9a9498495c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:50.199019 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ad94f855-c520-4255-a1dd-6a9a9498495c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:50.208765 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ad94f855-c520-4255-a1dd-6a9a9498495c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:50.208765 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ad94f855-c520-4255-a1dd-6a9a9498495c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:50.210976 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ad94f855-c520-4255-a1dd-6a9a9498495c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:50.212015 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ad94f855-c520-4255-a1dd-6a9a9498495c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:50.304777 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-92498675-611e-41a7-8b57-9e1003cfc9fc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 28655 microversion: 2.20 time: 0.139266 Jan 24 22:29:50.305449 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 192/382] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:50 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 28655 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:50.345903 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ad94f855-c520-4255-a1dd-6a9a9498495c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:50.353930 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ad94f855-c520-4255-a1dd-6a9a9498495c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1516 microversion: 2.1 time: 0.160203 Jan 24 22:29:50.354528 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 191/383] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:50 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:50.441625 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-5a1c5bba-9cf5-4c78-a3a6-2dd6fa6ff1f4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:50.442297 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-5a1c5bba-9cf5-4c78-a3a6-2dd6fa6ff1f4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:50.450001 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5a1c5bba-9cf5-4c78-a3a6-2dd6fa6ff1f4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:50.450355 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5a1c5bba-9cf5-4c78-a3a6-2dd6fa6ff1f4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:50.451146 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5a1c5bba-9cf5-4c78-a3a6-2dd6fa6ff1f4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:50.451613 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5a1c5bba-9cf5-4c78-a3a6-2dd6fa6ff1f4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:50.594983 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5a1c5bba-9cf5-4c78-a3a6-2dd6fa6ff1f4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:50.603033 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-5a1c5bba-9cf5-4c78-a3a6-2dd6fa6ff1f4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 200 len: 1314 microversion: 2.1 time: 0.165336 Jan 24 22:29:50.614557 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 193/384] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:50 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:50.680044 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-9b8efc78-15b7-4117-9179-dd48fa4513d8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:50.681036 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-9b8efc78-15b7-4117-9179-dd48fa4513d8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:50.687573 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9b8efc78-15b7-4117-9179-dd48fa4513d8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:50.688018 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9b8efc78-15b7-4117-9179-dd48fa4513d8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:50.688813 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9b8efc78-15b7-4117-9179-dd48fa4513d8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:50.689273 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9b8efc78-15b7-4117-9179-dd48fa4513d8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:50.814578 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-9b8efc78-15b7-4117-9179-dd48fa4513d8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 200 len: 38222 microversion: 2.1 time: 0.137743 Jan 24 22:29:50.815844 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 192/385] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:50 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 38222 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:29:50.832466 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ddc9ab3b-d6ef-4cc4-8259-31a4bb58716e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:50.833249 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ddc9ab3b-d6ef-4cc4-8259-31a4bb58716e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:50.842602 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ddc9ab3b-d6ef-4cc4-8259-31a4bb58716e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:50.843079 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ddc9ab3b-d6ef-4cc4-8259-31a4bb58716e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:50.844496 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ddc9ab3b-d6ef-4cc4-8259-31a4bb58716e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:50.844852 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ddc9ab3b-d6ef-4cc4-8259-31a4bb58716e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:50.873627 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ddc9ab3b-d6ef-4cc4-8259-31a4bb58716e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/ips" status: 200 len: 146 microversion: 2.1 time: 0.047284 Jan 24 22:29:50.874350 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 194/386] 10.222.0.84 () {58 vars in 1247 bytes} [Mon Jan 24 22:29:50 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/ips => generated 146 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:51.181544 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-285da75d-6b2e-48ee-afe0-d4e7ac74c7af tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:51.182233 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-285da75d-6b2e-48ee-afe0-d4e7ac74c7af tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:51.189821 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-285da75d-6b2e-48ee-afe0-d4e7ac74c7af tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:51.190263 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-285da75d-6b2e-48ee-afe0-d4e7ac74c7af tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:51.191032 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-285da75d-6b2e-48ee-afe0-d4e7ac74c7af tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:51.191464 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-285da75d-6b2e-48ee-afe0-d4e7ac74c7af tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:51.316532 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0c730452-3380-4fbd-8070-1d65daa8ba23 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:51.317551 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0c730452-3380-4fbd-8070-1d65daa8ba23 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:51.324148 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0c730452-3380-4fbd-8070-1d65daa8ba23 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:51.324597 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0c730452-3380-4fbd-8070-1d65daa8ba23 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:51.325463 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0c730452-3380-4fbd-8070-1d65daa8ba23 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:51.325897 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0c730452-3380-4fbd-8070-1d65daa8ba23 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:51.332221 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-285da75d-6b2e-48ee-afe0-d4e7ac74c7af tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:51.339957 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-285da75d-6b2e-48ee-afe0-d4e7ac74c7af tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1317 microversion: 2.1 time: 0.162455 Jan 24 22:29:51.340660 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 193/387] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:51 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:51.440288 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0c730452-3380-4fbd-8070-1d65daa8ba23 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 28655 microversion: 2.20 time: 0.127383 Jan 24 22:29:51.440959 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 195/388] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:51 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 28655 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:29:51.533095 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-fb060d83-0f23-4a83-bb2f-731579803dcb req-4be8059a-04e4-4ee9-87a5-a2381376d3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9febabf2-03a2-48f9-ab7d-b6648e470cb4", "name": "network-vif-plugged", "status": "completed", "tag": "43457efa-6a2a-438a-bc24-799ffc778296"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:51.534586 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:29:51.534586 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:29:51.542968 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-fb060d83-0f23-4a83-bb2f-731579803dcb req-4be8059a-04e4-4ee9-87a5-a2381376d3da service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:51.543436 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-fb060d83-0f23-4a83-bb2f-731579803dcb req-4be8059a-04e4-4ee9-87a5-a2381376d3da service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:51.554621 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-fb060d83-0f23-4a83-bb2f-731579803dcb req-4be8059a-04e4-4ee9-87a5-a2381376d3da service nova] Creating event network-vif-plugged:43457efa-6a2a-438a-bc24-799ffc778296 for instance 9febabf2-03a2-48f9-ab7d-b6648e470cb4 on hv-cinder-81322 Jan 24 22:29:51.559328 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-fb060d83-0f23-4a83-bb2f-731579803dcb req-4be8059a-04e4-4ee9-87a5-a2381376d3da service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031487 Jan 24 22:29:51.559914 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 194/389] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:51.621729 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0b77e981-af3e-4c7f-add6-46141d477605 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:51.622411 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0b77e981-af3e-4c7f-add6-46141d477605 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:51.630114 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0b77e981-af3e-4c7f-add6-46141d477605 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:51.630243 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0b77e981-af3e-4c7f-add6-46141d477605 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:51.631401 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0b77e981-af3e-4c7f-add6-46141d477605 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:51.632028 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0b77e981-af3e-4c7f-add6-46141d477605 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:51.730561 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-80ad0e7f-0706-4feb-bd96-253d730be3d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:51.732127 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-80ad0e7f-0706-4feb-bd96-253d730be3d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:51.740108 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-80ad0e7f-0706-4feb-bd96-253d730be3d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:51.740554 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-80ad0e7f-0706-4feb-bd96-253d730be3d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:51.741379 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-80ad0e7f-0706-4feb-bd96-253d730be3d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:51.741815 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-80ad0e7f-0706-4feb-bd96-253d730be3d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:51.770816 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.objects.instance [None req-80ad0e7f-0706-4feb-bd96-253d730be3d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lazy-loading 'flavor' on Instance uuid a871432f-36c3-495a-8269-9de0a0e45315 {{(pid=116466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:29:51.790993 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0b77e981-af3e-4c7f-add6-46141d477605 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:51.799076 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0b77e981-af3e-4c7f-add6-46141d477605 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 200 len: 1314 microversion: 2.1 time: 0.181435 Jan 24 22:29:51.799667 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 196/390] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:51 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:51.893729 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-80ad0e7f-0706-4feb-bd96-253d730be3d2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "POST /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/action" status: 200 len: 32 microversion: 2.1 time: 0.167764 Jan 24 22:29:51.894542 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 195/391] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:29:51 2022] POST /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 22:29:51.903594 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4dd7b4da-b715-4cff-a95c-8c3834c0fe28 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:51.904533 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4dd7b4da-b715-4cff-a95c-8c3834c0fe28 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:51.912164 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4dd7b4da-b715-4cff-a95c-8c3834c0fe28 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:51.912608 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4dd7b4da-b715-4cff-a95c-8c3834c0fe28 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:51.913601 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4dd7b4da-b715-4cff-a95c-8c3834c0fe28 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:51.914143 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4dd7b4da-b715-4cff-a95c-8c3834c0fe28 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:52.051038 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4dd7b4da-b715-4cff-a95c-8c3834c0fe28 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:52.058616 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4dd7b4da-b715-4cff-a95c-8c3834c0fe28 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.158874 Jan 24 22:29:52.059180 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 197/392] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:51 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:52.367127 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7c9fe047-0bbe-4be7-830a-d4a2620dc2c2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:52.368158 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7c9fe047-0bbe-4be7-830a-d4a2620dc2c2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:52.379874 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7c9fe047-0bbe-4be7-830a-d4a2620dc2c2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:52.380350 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7c9fe047-0bbe-4be7-830a-d4a2620dc2c2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:52.381246 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7c9fe047-0bbe-4be7-830a-d4a2620dc2c2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:52.381777 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7c9fe047-0bbe-4be7-830a-d4a2620dc2c2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:52.452075 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b9265219-c759-4c7a-a3de-e792b598e9fa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:52.453660 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b9265219-c759-4c7a-a3de-e792b598e9fa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:52.464839 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b9265219-c759-4c7a-a3de-e792b598e9fa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:52.465359 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b9265219-c759-4c7a-a3de-e792b598e9fa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:52.466321 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b9265219-c759-4c7a-a3de-e792b598e9fa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:52.466938 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b9265219-c759-4c7a-a3de-e792b598e9fa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:52.547302 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7c9fe047-0bbe-4be7-830a-d4a2620dc2c2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:52.556390 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7c9fe047-0bbe-4be7-830a-d4a2620dc2c2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1317 microversion: 2.1 time: 0.200663 Jan 24 22:29:52.556962 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 196/393] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:52 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:52.602055 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b9265219-c759-4c7a-a3de-e792b598e9fa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 28655 microversion: 2.20 time: 0.153701 Jan 24 22:29:52.602698 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 198/394] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:52 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 28655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:29:52.815910 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-5e770280-af95-42b4-8833-7955223ee49e tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:52.816688 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-5e770280-af95-42b4-8833-7955223ee49e tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:52.823454 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5e770280-af95-42b4-8833-7955223ee49e tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:52.823940 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5e770280-af95-42b4-8833-7955223ee49e tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:52.824771 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5e770280-af95-42b4-8833-7955223ee49e tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:52.825439 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5e770280-af95-42b4-8833-7955223ee49e tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:53.077331 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-de42ec53-bf4d-4092-968f-9e4be9617810 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:53.078428 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-de42ec53-bf4d-4092-968f-9e4be9617810 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:53.086243 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-de42ec53-bf4d-4092-968f-9e4be9617810 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:53.086692 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-de42ec53-bf4d-4092-968f-9e4be9617810 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:53.087486 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-de42ec53-bf4d-4092-968f-9e4be9617810 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:53.087919 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-de42ec53-bf4d-4092-968f-9e4be9617810 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:53.171773 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-5e770280-af95-42b4-8833-7955223ee49e tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:53.179714 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-5e770280-af95-42b4-8833-7955223ee49e tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 200 len: 1314 microversion: 2.1 time: 0.367784 Jan 24 22:29:53.180282 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 197/395] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:52 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:53.256324 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-de42ec53-bf4d-4092-968f-9e4be9617810 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:53.263649 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-de42ec53-bf4d-4092-968f-9e4be9617810 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.190534 Jan 24 22:29:53.264630 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 199/396] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:53 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:53.574263 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ee09e8a7-53bc-42be-be84-e0d5aedaee65 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:53.574842 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ee09e8a7-53bc-42be-be84-e0d5aedaee65 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:53.581299 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ee09e8a7-53bc-42be-be84-e0d5aedaee65 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:53.581746 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ee09e8a7-53bc-42be-be84-e0d5aedaee65 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:53.582516 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ee09e8a7-53bc-42be-be84-e0d5aedaee65 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:53.582916 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ee09e8a7-53bc-42be-be84-e0d5aedaee65 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:53.613929 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-fd3b64a7-a37d-4e19-aa46-64a1446b8b00 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:53.614840 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-fd3b64a7-a37d-4e19-aa46-64a1446b8b00 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:53.621466 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fd3b64a7-a37d-4e19-aa46-64a1446b8b00 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:53.622031 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fd3b64a7-a37d-4e19-aa46-64a1446b8b00 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:53.622721 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fd3b64a7-a37d-4e19-aa46-64a1446b8b00 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:53.623153 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fd3b64a7-a37d-4e19-aa46-64a1446b8b00 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:53.716457 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ee09e8a7-53bc-42be-be84-e0d5aedaee65 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:53.724892 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ee09e8a7-53bc-42be-be84-e0d5aedaee65 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1317 microversion: 2.1 time: 0.154275 Jan 24 22:29:53.725494 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 198/397] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:53 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:53.729862 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8372ec14-dd7b-43fc-89df-585b2f8d423a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9683a6a-6aa0-4843-ae6b-7119e13d13ac"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:53.731407 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8372ec14-dd7b-43fc-89df-585b2f8d423a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:53.737850 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8372ec14-dd7b-43fc-89df-585b2f8d423a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:53.738353 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8372ec14-dd7b-43fc-89df-585b2f8d423a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:53.739122 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8372ec14-dd7b-43fc-89df-585b2f8d423a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:53.739542 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8372ec14-dd7b-43fc-89df-585b2f8d423a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:53.850159 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-fd3b64a7-a37d-4e19-aa46-64a1446b8b00 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 29199 microversion: 2.20 time: 0.239757 Jan 24 22:29:53.850807 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 200/398] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:53 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 29199 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:54.114184 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8372ec14-dd7b-43fc-89df-585b2f8d423a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387511 Jan 24 22:29:54.114855 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 199/399] 10.222.0.84 () {60 vars in 1322 bytes} [Mon Jan 24 22:29:53 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:54.200025 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2bcdd833-2a38-4884-a33f-ecb697c38ed4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:54.200687 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2bcdd833-2a38-4884-a33f-ecb697c38ed4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:54.208543 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2bcdd833-2a38-4884-a33f-ecb697c38ed4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:54.209010 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2bcdd833-2a38-4884-a33f-ecb697c38ed4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:54.209799 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2bcdd833-2a38-4884-a33f-ecb697c38ed4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:54.210234 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2bcdd833-2a38-4884-a33f-ecb697c38ed4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:54.283702 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-bb60826f-dc96-4414-8b43-de4b9c9809fd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:54.284127 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-bb60826f-dc96-4414-8b43-de4b9c9809fd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:54.290509 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bb60826f-dc96-4414-8b43-de4b9c9809fd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:54.291031 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bb60826f-dc96-4414-8b43-de4b9c9809fd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:54.291858 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bb60826f-dc96-4414-8b43-de4b9c9809fd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:54.292290 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bb60826f-dc96-4414-8b43-de4b9c9809fd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:54.386023 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2bcdd833-2a38-4884-a33f-ecb697c38ed4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:54.397193 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2bcdd833-2a38-4884-a33f-ecb697c38ed4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 200 len: 1497 microversion: 2.1 time: 0.202367 Jan 24 22:29:54.399168 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 201/400] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:54 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 1497 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:54.455796 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-bb60826f-dc96-4414-8b43-de4b9c9809fd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:54.463109 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-bb60826f-dc96-4414-8b43-de4b9c9809fd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.184881 Jan 24 22:29:54.463944 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 200/401] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:54 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:54.751825 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-aecf79d8-af35-462d-a445-b4d1ef8219ee tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:54.752446 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-aecf79d8-af35-462d-a445-b4d1ef8219ee tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:54.759596 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-aecf79d8-af35-462d-a445-b4d1ef8219ee tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:54.760113 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-aecf79d8-af35-462d-a445-b4d1ef8219ee tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:54.761043 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-aecf79d8-af35-462d-a445-b4d1ef8219ee tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:54.761497 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-aecf79d8-af35-462d-a445-b4d1ef8219ee tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:54.862376 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-d38ede3b-899f-4f94-b7ff-b63887357f42 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:54.863354 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d38ede3b-899f-4f94-b7ff-b63887357f42 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:54.870005 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d38ede3b-899f-4f94-b7ff-b63887357f42 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:54.870450 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d38ede3b-899f-4f94-b7ff-b63887357f42 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:54.871223 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d38ede3b-899f-4f94-b7ff-b63887357f42 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:54.871651 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d38ede3b-899f-4f94-b7ff-b63887357f42 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:54.912884 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-aecf79d8-af35-462d-a445-b4d1ef8219ee tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:54.920538 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-aecf79d8-af35-462d-a445-b4d1ef8219ee tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1317 microversion: 2.1 time: 0.174134 Jan 24 22:29:54.921125 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 202/402] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:54 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:55.023810 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-d38ede3b-899f-4f94-b7ff-b63887357f42 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 30069 microversion: 2.20 time: 0.165267 Jan 24 22:29:55.024469 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 201/403] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:54 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 30069 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:55.480333 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-56c14604-a29e-4d4d-bdf4-d68c0e509c91 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:55.480722 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-56c14604-a29e-4d4d-bdf4-d68c0e509c91 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:55.487165 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-56c14604-a29e-4d4d-bdf4-d68c0e509c91 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:55.487605 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-56c14604-a29e-4d4d-bdf4-d68c0e509c91 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:55.488345 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-56c14604-a29e-4d4d-bdf4-d68c0e509c91 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:55.488770 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-56c14604-a29e-4d4d-bdf4-d68c0e509c91 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:55.622174 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-56c14604-a29e-4d4d-bdf4-d68c0e509c91 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:55.631265 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-56c14604-a29e-4d4d-bdf4-d68c0e509c91 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.154977 Jan 24 22:29:55.631832 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 203/404] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:55 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:55.777552 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e804eca7-d2d7-495c-8e52-8133a1febb1c tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:55.778171 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e804eca7-d2d7-495c-8e52-8133a1febb1c tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:55.785294 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e804eca7-d2d7-495c-8e52-8133a1febb1c tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:55.785737 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e804eca7-d2d7-495c-8e52-8133a1febb1c tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:55.786500 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e804eca7-d2d7-495c-8e52-8133a1febb1c tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:55.786925 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e804eca7-d2d7-495c-8e52-8133a1febb1c tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:55.816793 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e804eca7-d2d7-495c-8e52-8133a1febb1c tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Going to try to terminate instance {{(pid=116466) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:29:55.896915 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e804eca7-d2d7-495c-8e52-8133a1febb1c tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "DELETE /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 204 len: 0 microversion: 2.1 time: 0.123176 Jan 24 22:29:55.897867 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 202/405] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:29:55 2022] DELETE /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:29:55.906839 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c08de479-bdd0-49f6-b115-f9f14f7767a1 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:55.907597 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c08de479-bdd0-49f6-b115-f9f14f7767a1 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:55.914583 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c08de479-bdd0-49f6-b115-f9f14f7767a1 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:55.915109 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c08de479-bdd0-49f6-b115-f9f14f7767a1 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:55.915957 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c08de479-bdd0-49f6-b115-f9f14f7767a1 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:55.916440 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c08de479-bdd0-49f6-b115-f9f14f7767a1 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:55.937741 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6f921b87-d283-43f6-a2eb-f53a81fd44fb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:55.938681 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6f921b87-d283-43f6-a2eb-f53a81fd44fb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:55.945029 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6f921b87-d283-43f6-a2eb-f53a81fd44fb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:55.945461 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6f921b87-d283-43f6-a2eb-f53a81fd44fb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:55.946231 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6f921b87-d283-43f6-a2eb-f53a81fd44fb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:55.946657 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6f921b87-d283-43f6-a2eb-f53a81fd44fb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:56.104943 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-c08de479-bdd0-49f6-b115-f9f14f7767a1 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:56.112623 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c08de479-bdd0-49f6-b115-f9f14f7767a1 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 200 len: 1503 microversion: 2.1 time: 0.210696 Jan 24 22:29:56.113228 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 204/406] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:55 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:56.117530 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-dedb6e78-343f-40fb-bed0-7ae8426975bf req-632eec30-8d70-416e-a672-f727100b0a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a6892a-6bcf-48a9-ba54-e2f6fce165c8", "name": "network-vif-plugged", "status": "completed", "tag": "d633875b-72bb-44b2-823b-29984eecca9f"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:56.119115 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:29:56.119115 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:29:56.125939 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-dedb6e78-343f-40fb-bed0-7ae8426975bf req-632eec30-8d70-416e-a672-f727100b0a42 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:56.126308 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-dedb6e78-343f-40fb-bed0-7ae8426975bf req-632eec30-8d70-416e-a672-f727100b0a42 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:56.129645 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-6f921b87-d283-43f6-a2eb-f53a81fd44fb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:56.137023 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6f921b87-d283-43f6-a2eb-f53a81fd44fb tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1317 microversion: 2.1 time: 0.203220 Jan 24 22:29:56.137588 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 203/407] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:55 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:29:56.137719 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-dedb6e78-343f-40fb-bed0-7ae8426975bf req-632eec30-8d70-416e-a672-f727100b0a42 service nova] Creating event network-vif-plugged:d633875b-72bb-44b2-823b-29984eecca9f for instance 60a6892a-6bcf-48a9-ba54-e2f6fce165c8 on hv-cinder-81322 Jan 24 22:29:56.143057 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-dedb6e78-343f-40fb-bed0-7ae8426975bf req-632eec30-8d70-416e-a672-f727100b0a42 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028737 Jan 24 22:29:56.143636 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 205/408] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:29:56.144516 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-44f37f66-3c28-4862-bf02-a069ffa8f60b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:56.145739 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-44f37f66-3c28-4862-bf02-a069ffa8f60b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:56.152037 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-44f37f66-3c28-4862-bf02-a069ffa8f60b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:56.152483 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-44f37f66-3c28-4862-bf02-a069ffa8f60b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:56.153284 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-44f37f66-3c28-4862-bf02-a069ffa8f60b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:56.153743 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-44f37f66-3c28-4862-bf02-a069ffa8f60b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:56.331194 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-44f37f66-3c28-4862-bf02-a069ffa8f60b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 30889 microversion: 2.20 time: 0.190667 Jan 24 22:29:56.332226 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 204/409] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:56 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 30889 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:56.654705 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f90d47bf-3c7c-4308-bc84-247efbdfb24e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:56.655731 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-f90d47bf-3c7c-4308-bc84-247efbdfb24e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:56.667091 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f90d47bf-3c7c-4308-bc84-247efbdfb24e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:56.667845 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f90d47bf-3c7c-4308-bc84-247efbdfb24e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:56.669218 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f90d47bf-3c7c-4308-bc84-247efbdfb24e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:56.669938 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f90d47bf-3c7c-4308-bc84-247efbdfb24e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:56.815001 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-f90d47bf-3c7c-4308-bc84-247efbdfb24e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:56.825775 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-f90d47bf-3c7c-4308-bc84-247efbdfb24e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.177654 Jan 24 22:29:56.826650 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 206/410] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:56 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:57.134552 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-cacf6781-d3dc-4ee5-b63b-2286e147b46f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:57.135692 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-cacf6781-d3dc-4ee5-b63b-2286e147b46f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:57.147685 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cacf6781-d3dc-4ee5-b63b-2286e147b46f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:57.148446 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cacf6781-d3dc-4ee5-b63b-2286e147b46f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:57.150291 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cacf6781-d3dc-4ee5-b63b-2286e147b46f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:57.150629 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cacf6781-d3dc-4ee5-b63b-2286e147b46f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:57.157393 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-bda9de53-9e36-4fda-ab2f-215ff9a9fa77 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:57.157992 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-bda9de53-9e36-4fda-ab2f-215ff9a9fa77 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:57.164482 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bda9de53-9e36-4fda-ab2f-215ff9a9fa77 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:57.164931 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bda9de53-9e36-4fda-ab2f-215ff9a9fa77 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:57.165743 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bda9de53-9e36-4fda-ab2f-215ff9a9fa77 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:57.166168 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bda9de53-9e36-4fda-ab2f-215ff9a9fa77 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:57.352571 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-cacf6781-d3dc-4ee5-b63b-2286e147b46f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:57.358099 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-bda9de53-9e36-4fda-ab2f-215ff9a9fa77 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:57.361059 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-cacf6781-d3dc-4ee5-b63b-2286e147b46f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 200 len: 1503 microversion: 2.1 time: 0.233255 Jan 24 22:29:57.361837 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 205/411] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:57 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:57.366504 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-bda9de53-9e36-4fda-ab2f-215ff9a9fa77 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1317 microversion: 2.1 time: 0.214694 Jan 24 22:29:57.366680 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7cc92cc0-4faa-4950-bfb2-038565635cb7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:57.367045 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 207/412] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:57 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:57.368034 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7cc92cc0-4faa-4950-bfb2-038565635cb7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:57.374289 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7cc92cc0-4faa-4950-bfb2-038565635cb7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:57.374734 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7cc92cc0-4faa-4950-bfb2-038565635cb7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:57.375557 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7cc92cc0-4faa-4950-bfb2-038565635cb7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:57.375982 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7cc92cc0-4faa-4950-bfb2-038565635cb7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:57.529497 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7cc92cc0-4faa-4950-bfb2-038565635cb7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 32002 microversion: 2.20 time: 0.166286 Jan 24 22:29:57.530118 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 206/413] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:57 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 32002 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:57.849762 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ed4225bc-8354-4dbc-9ee0-037b44c5f7cc tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:57.850363 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ed4225bc-8354-4dbc-9ee0-037b44c5f7cc tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:57.863238 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ed4225bc-8354-4dbc-9ee0-037b44c5f7cc tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:57.863686 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ed4225bc-8354-4dbc-9ee0-037b44c5f7cc tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:57.864485 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ed4225bc-8354-4dbc-9ee0-037b44c5f7cc tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:57.865214 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ed4225bc-8354-4dbc-9ee0-037b44c5f7cc tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:57.998258 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ed4225bc-8354-4dbc-9ee0-037b44c5f7cc tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:58.005745 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ed4225bc-8354-4dbc-9ee0-037b44c5f7cc tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.159666 Jan 24 22:29:58.006588 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 208/414] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:57 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:58.378594 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a634f35b-dd14-4277-a30d-7521f7274f24 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:58.379279 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a634f35b-dd14-4277-a30d-7521f7274f24 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:58.384011 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-94862216-3850-4b4a-9b08-030b808aa799 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:58.384624 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-94862216-3850-4b4a-9b08-030b808aa799 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:58.386410 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a634f35b-dd14-4277-a30d-7521f7274f24 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:58.386865 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a634f35b-dd14-4277-a30d-7521f7274f24 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:58.387621 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a634f35b-dd14-4277-a30d-7521f7274f24 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:58.388198 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a634f35b-dd14-4277-a30d-7521f7274f24 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:58.392131 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-94862216-3850-4b4a-9b08-030b808aa799 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:58.392903 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-94862216-3850-4b4a-9b08-030b808aa799 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:58.394496 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-94862216-3850-4b4a-9b08-030b808aa799 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:58.394942 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-94862216-3850-4b4a-9b08-030b808aa799 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:58.589770 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a634f35b-dd14-4277-a30d-7521f7274f24 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:58.593318 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-94862216-3850-4b4a-9b08-030b808aa799 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:58.597339 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a634f35b-dd14-4277-a30d-7521f7274f24 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 200 len: 1503 microversion: 2.1 time: 0.223066 Jan 24 22:29:58.597915 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 207/415] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:58 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 1503 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:58.601036 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-94862216-3850-4b4a-9b08-030b808aa799 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1317 microversion: 2.1 time: 0.221671 Jan 24 22:29:58.601748 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 209/416] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:58 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:58.602704 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-9eb9ffa0-05d0-4567-b396-ee9ed7c36a14 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:58.603622 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-9eb9ffa0-05d0-4567-b396-ee9ed7c36a14 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:58.610379 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9eb9ffa0-05d0-4567-b396-ee9ed7c36a14 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:58.610759 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9eb9ffa0-05d0-4567-b396-ee9ed7c36a14 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:58.611526 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9eb9ffa0-05d0-4567-b396-ee9ed7c36a14 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:58.611953 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9eb9ffa0-05d0-4567-b396-ee9ed7c36a14 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:58.831868 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-9eb9ffa0-05d0-4567-b396-ee9ed7c36a14 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 32699 microversion: 2.20 time: 0.232672 Jan 24 22:29:58.832523 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 208/417] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:58 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 32699 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:29:59.024466 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f309055b-c81c-43b9-af55-a63aa37dd276 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:59.025106 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-f309055b-c81c-43b9-af55-a63aa37dd276 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:59.031840 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f309055b-c81c-43b9-af55-a63aa37dd276 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:59.032275 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f309055b-c81c-43b9-af55-a63aa37dd276 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:59.033067 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f309055b-c81c-43b9-af55-a63aa37dd276 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:59.033515 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f309055b-c81c-43b9-af55-a63aa37dd276 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:59.174009 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-f309055b-c81c-43b9-af55-a63aa37dd276 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:59.185695 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-f309055b-c81c-43b9-af55-a63aa37dd276 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.164613 Jan 24 22:29:59.186448 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 210/418] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:59 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:59.617748 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-602e1ce9-3c60-4f92-9964-5e4117e26e94 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:59.618178 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-9c393d08-c60a-46f2-a01b-cd51a85e1c76 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:29:59.618624 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-602e1ce9-3c60-4f92-9964-5e4117e26e94 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:59.619088 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-9c393d08-c60a-46f2-a01b-cd51a85e1c76 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:59.626350 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-602e1ce9-3c60-4f92-9964-5e4117e26e94 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:59.626824 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-602e1ce9-3c60-4f92-9964-5e4117e26e94 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:59.626934 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9c393d08-c60a-46f2-a01b-cd51a85e1c76 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:59.627434 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9c393d08-c60a-46f2-a01b-cd51a85e1c76 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:59.627578 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-602e1ce9-3c60-4f92-9964-5e4117e26e94 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:59.628322 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9c393d08-c60a-46f2-a01b-cd51a85e1c76 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:59.628432 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-602e1ce9-3c60-4f92-9964-5e4117e26e94 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:59.628759 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9c393d08-c60a-46f2-a01b-cd51a85e1c76 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:59.822040 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-602e1ce9-3c60-4f92-9964-5e4117e26e94 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:59.825341 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-9c393d08-c60a-46f2-a01b-cd51a85e1c76 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:29:59.831843 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-602e1ce9-3c60-4f92-9964-5e4117e26e94 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1507 microversion: 2.1 time: 0.217737 Jan 24 22:29:59.832804 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 211/419] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:59 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:59.834478 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-9c393d08-c60a-46f2-a01b-cd51a85e1c76 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 200 len: 1503 microversion: 2.1 time: 0.220259 Jan 24 22:29:59.835089 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 209/420] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:29:59 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:29:59.843671 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1ee35d4d-9702-4fb8-a06b-3d15ab1a6aa5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:29:59.844978 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1ee35d4d-9702-4fb8-a06b-3d15ab1a6aa5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:29:59.851845 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1ee35d4d-9702-4fb8-a06b-3d15ab1a6aa5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:59.852367 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1ee35d4d-9702-4fb8-a06b-3d15ab1a6aa5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:29:59.853252 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1ee35d4d-9702-4fb8-a06b-3d15ab1a6aa5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:29:59.853750 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1ee35d4d-9702-4fb8-a06b-3d15ab1a6aa5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:00.107722 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1ee35d4d-9702-4fb8-a06b-3d15ab1a6aa5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 33101 microversion: 2.20 time: 0.267602 Jan 24 22:30:00.111656 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 212/421] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:29:59 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 33101 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:30:00.203289 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7c996265-0701-488b-adaa-5047ec87ae25 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:00.204097 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7c996265-0701-488b-adaa-5047ec87ae25 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:00.210382 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7c996265-0701-488b-adaa-5047ec87ae25 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:00.210828 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7c996265-0701-488b-adaa-5047ec87ae25 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:00.211604 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7c996265-0701-488b-adaa-5047ec87ae25 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:00.212035 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7c996265-0701-488b-adaa-5047ec87ae25 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:00.346220 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7c996265-0701-488b-adaa-5047ec87ae25 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:00.354154 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7c996265-0701-488b-adaa-5047ec87ae25 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.154598 Jan 24 22:30:00.355008 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 210/422] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:00 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:00.546218 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-dd5c6b5e-6d8b-4709-8179-c1cb4ea44ac7 req-4a0bdf91-caff-4936-a5b5-8138f361f766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9febabf2-03a2-48f9-ab7d-b6648e470cb4", "name": "network-vif-deleted", "tag": "43457efa-6a2a-438a-bc24-799ffc778296"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:00.548041 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:30:00.548041 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:30:00.557251 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-dd5c6b5e-6d8b-4709-8179-c1cb4ea44ac7 req-4a0bdf91-caff-4936-a5b5-8138f361f766 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:00.557691 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-dd5c6b5e-6d8b-4709-8179-c1cb4ea44ac7 req-4a0bdf91-caff-4936-a5b5-8138f361f766 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:00.570676 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-dd5c6b5e-6d8b-4709-8179-c1cb4ea44ac7 req-4a0bdf91-caff-4936-a5b5-8138f361f766 service nova] Creating event network-vif-deleted:43457efa-6a2a-438a-bc24-799ffc778296 for instance 9febabf2-03a2-48f9-ab7d-b6648e470cb4 on hv-cinder-81322 Jan 24 22:30:00.576310 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-dd5c6b5e-6d8b-4709-8179-c1cb4ea44ac7 req-4a0bdf91-caff-4936-a5b5-8138f361f766 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033804 Jan 24 22:30:00.577280 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 213/423] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:30:00.851078 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-d51a9437-909a-4077-b1ad-2425f2c73b93 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:00.851651 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d51a9437-909a-4077-b1ad-2425f2c73b93 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:00.858125 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d51a9437-909a-4077-b1ad-2425f2c73b93 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:00.858566 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d51a9437-909a-4077-b1ad-2425f2c73b93 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:00.859390 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d51a9437-909a-4077-b1ad-2425f2c73b93 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:00.859868 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d51a9437-909a-4077-b1ad-2425f2c73b93 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:00.892334 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d51a9437-909a-4077-b1ad-2425f2c73b93 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:00.892827 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d51a9437-909a-4077-b1ad-2425f2c73b93 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:00.893388 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.objects.instance [None req-d51a9437-909a-4077-b1ad-2425f2c73b93 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lazy-loading 'fault' on Instance uuid 9febabf2-03a2-48f9-ab7d-b6648e470cb4 {{(pid=116466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:30:00.934129 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d51a9437-909a-4077-b1ad-2425f2c73b93 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:00.941872 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-d51a9437-909a-4077-b1ad-2425f2c73b93 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 200 len: 1304 microversion: 2.1 time: 0.094205 Jan 24 22:30:00.942444 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 211/424] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:00 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:01.120373 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-54119f69-eadb-4052-b779-320ba6503539 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:01.121515 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-54119f69-eadb-4052-b779-320ba6503539 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:01.128294 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-54119f69-eadb-4052-b779-320ba6503539 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:01.128736 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-54119f69-eadb-4052-b779-320ba6503539 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:01.129541 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-54119f69-eadb-4052-b779-320ba6503539 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:01.129971 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-54119f69-eadb-4052-b779-320ba6503539 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:01.159832 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-0e74b892-adaf-444e-b852-2ad29aa102bc tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a92711b5-80fa-4e95-bf70-f547e78d3f4e"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:01.160941 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-0e74b892-adaf-444e-b852-2ad29aa102bc tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:01.167130 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0e74b892-adaf-444e-b852-2ad29aa102bc tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:01.167606 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0e74b892-adaf-444e-b852-2ad29aa102bc tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:01.168371 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0e74b892-adaf-444e-b852-2ad29aa102bc tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:01.168801 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0e74b892-adaf-444e-b852-2ad29aa102bc tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:01.275699 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-54119f69-eadb-4052-b779-320ba6503539 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 33494 microversion: 2.20 time: 0.159580 Jan 24 22:30:01.276404 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 214/425] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:30:01 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 33494 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:30:01.371955 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-698d9d2c-e134-4798-b2af-61ac3ef493c1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:01.372638 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-698d9d2c-e134-4798-b2af-61ac3ef493c1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:01.379819 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-698d9d2c-e134-4798-b2af-61ac3ef493c1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:01.380257 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-698d9d2c-e134-4798-b2af-61ac3ef493c1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:01.381042 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-698d9d2c-e134-4798-b2af-61ac3ef493c1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:01.381477 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-698d9d2c-e134-4798-b2af-61ac3ef493c1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:01.541113 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-698d9d2c-e134-4798-b2af-61ac3ef493c1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:01.548516 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-698d9d2c-e134-4798-b2af-61ac3ef493c1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.180864 Jan 24 22:30:01.557959 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 215/426] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:01 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:30:01.573359 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-0e74b892-adaf-444e-b852-2ad29aa102bc tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "POST /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417726 Jan 24 22:30:01.574034 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 212/427] 10.222.0.84 () {60 vars in 1322 bytes} [Mon Jan 24 22:30:01 2022] POST /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:30:01.960386 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-672e35b3-788e-429f-b5dd-3262304597a8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:01.961273 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-672e35b3-788e-429f-b5dd-3262304597a8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: 9febabf2-03a2-48f9-ab7d-b6648e470cb4] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:01.967881 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-672e35b3-788e-429f-b5dd-3262304597a8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:01.968406 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-672e35b3-788e-429f-b5dd-3262304597a8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:01.969352 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-672e35b3-788e-429f-b5dd-3262304597a8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:01.970273 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-672e35b3-788e-429f-b5dd-3262304597a8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:01.985919 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-672e35b3-788e-429f-b5dd-3262304597a8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] HTTP exception thrown: Instance 9febabf2-03a2-48f9-ab7d-b6648e470cb4 could not be found. Jan 24 22:30:01.986757 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-672e35b3-788e-429f-b5dd-3262304597a8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Returning 404 to user: Instance 9febabf2-03a2-48f9-ab7d-b6648e470cb4 could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:30:01.989340 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-672e35b3-788e-429f-b5dd-3262304597a8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4" status: 404 len: 111 microversion: 2.1 time: 0.031778 Jan 24 22:30:01.989862 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 216/428] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:01 2022] GET /compute/v2.1/servers/9febabf2-03a2-48f9-ab7d-b6648e470cb4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:30:02.041927 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b46d09a7-3891-42e4-8dec-9ee4c4c8daf9 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-422419419", "imageRef": "4fe12948-6887-4759-900b-f3ee39409e75", "flavorRef": "452", "networks": [{"uuid": "10de36a5-6511-4593-99b8-3e13068c9c6a"}]}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:02.106693 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.network.neutron [None req-b46d09a7-3891-42e4-8dec-9ee4c4c8daf9 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] validate_networks() for [('10de36a5-6511-4593-99b8-3e13068c9c6a', None, None, None, None, None)] {{(pid=116466) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:30:02.288320 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4cc4a6ab-7ca5-4149-9671-0e4c08515d8d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:02.289359 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4cc4a6ab-7ca5-4149-9671-0e4c08515d8d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:02.295669 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4cc4a6ab-7ca5-4149-9671-0e4c08515d8d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:02.296105 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4cc4a6ab-7ca5-4149-9671-0e4c08515d8d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:02.296876 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4cc4a6ab-7ca5-4149-9671-0e4c08515d8d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:02.297425 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4cc4a6ab-7ca5-4149-9671-0e4c08515d8d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:02.435073 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4cc4a6ab-7ca5-4149-9671-0e4c08515d8d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 33978 microversion: 2.20 time: 0.150427 Jan 24 22:30:02.436127 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 217/429] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:30:02 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 33978 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:30:02.489797 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-b46d09a7-3891-42e4-8dec-9ee4c4c8daf9 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Flavor limits 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:30:02.490283 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-b46d09a7-3891-42e4-8dec-9ee4c4c8daf9 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Image limits 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:30:02.490860 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-b46d09a7-3891-42e4-8dec-9ee4c4c8daf9 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Flavor pref 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:30:02.491310 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-b46d09a7-3891-42e4-8dec-9ee4c4c8daf9 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Image pref 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:30:02.491783 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-b46d09a7-3891-42e4-8dec-9ee4c4c8daf9 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:30:02.500649 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b46d09a7-3891-42e4-8dec-9ee4c4c8daf9 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:02.501377 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b46d09a7-3891-42e4-8dec-9ee4c4c8daf9 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:02.502253 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b46d09a7-3891-42e4-8dec-9ee4c4c8daf9 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:02.502685 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b46d09a7-3891-42e4-8dec-9ee4c4c8daf9 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:02.519053 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-b46d09a7-3891-42e4-8dec-9ee4c4c8daf9 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Getting quotas for project f745f8e89f0b47f7a49e565becce2c16. Resources: {'cores', 'instances', 'ram'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:30:02.523184 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-b46d09a7-3891-42e4-8dec-9ee4c4c8daf9 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Getting quotas for user 763ba0faf8324e039936fc2086ee6d54 and project f745f8e89f0b47f7a49e565becce2c16. Resources: {'cores', 'instances', 'ram'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:30:02.533652 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b46d09a7-3891-42e4-8dec-9ee4c4c8daf9 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Going to run 1 instances... {{(pid=116466) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:30:02.536094 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b46d09a7-3891-42e4-8dec-9ee4c4c8daf9 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fe12948-6887-4759-900b-f3ee39409e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:30:02.567384 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-bfcc53aa-f673-4abc-8c5f-4fbd47521c5f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:02.568191 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-bfcc53aa-f673-4abc-8c5f-4fbd47521c5f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:02.576329 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bfcc53aa-f673-4abc-8c5f-4fbd47521c5f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:02.577276 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bfcc53aa-f673-4abc-8c5f-4fbd47521c5f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:02.578070 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bfcc53aa-f673-4abc-8c5f-4fbd47521c5f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:02.578577 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bfcc53aa-f673-4abc-8c5f-4fbd47521c5f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:02.584367 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b46d09a7-3891-42e4-8dec-9ee4c4c8daf9 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547328 Jan 24 22:30:02.585358 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 213/430] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:30:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 24 22:30:02.602840 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-89c9d685-53da-475e-bf04-4df05528bc71 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:02.603715 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-89c9d685-53da-475e-bf04-4df05528bc71 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:02.737224 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-89c9d685-53da-475e-bf04-4df05528bc71 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:02.744816 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-89c9d685-53da-475e-bf04-4df05528bc71 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 200 len: 1213 microversion: 2.1 time: 0.153527 Jan 24 22:30:02.748356 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 214/431] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:02 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 1213 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:02.813309 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-bfcc53aa-f673-4abc-8c5f-4fbd47521c5f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:02.821716 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-bfcc53aa-f673-4abc-8c5f-4fbd47521c5f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.258497 Jan 24 22:30:02.822430 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 218/432] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:02 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:02.902349 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b4c5d23e-6188-4e52-8f64-9e6a038f2085 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:02.908481 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b4c5d23e-6188-4e52-8f64-9e6a038f2085 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:02.908929 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b4c5d23e-6188-4e52-8f64-9e6a038f2085 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:02.973081 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b4c5d23e-6188-4e52-8f64-9e6a038f2085 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Going to try to stop instance {{(pid=116466) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 24 22:30:03.022261 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b4c5d23e-6188-4e52-8f64-9e6a038f2085 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 202 len: 0 microversion: 2.1 time: 0.123760 Jan 24 22:30:03.022938 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 215/433] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:30:02 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:30:03.031328 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-41565d46-fe47-422e-99dd-1d098ab16379 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:03.032066 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-41565d46-fe47-422e-99dd-1d098ab16379 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:03.039335 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-41565d46-fe47-422e-99dd-1d098ab16379 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:03.039770 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-41565d46-fe47-422e-99dd-1d098ab16379 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:03.040789 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-41565d46-fe47-422e-99dd-1d098ab16379 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:03.041417 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-41565d46-fe47-422e-99dd-1d098ab16379 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:03.196674 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-41565d46-fe47-422e-99dd-1d098ab16379 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:03.204938 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-41565d46-fe47-422e-99dd-1d098ab16379 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1723 microversion: 2.1 time: 0.177071 Jan 24 22:30:03.205379 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 219/434] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:03 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:03.448285 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-fb1e8361-2c07-4896-bb8b-ed5e698a43d4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:03.449380 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-fb1e8361-2c07-4896-bb8b-ed5e698a43d4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:03.455633 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fb1e8361-2c07-4896-bb8b-ed5e698a43d4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:03.456116 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fb1e8361-2c07-4896-bb8b-ed5e698a43d4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:03.456902 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fb1e8361-2c07-4896-bb8b-ed5e698a43d4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:03.457439 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fb1e8361-2c07-4896-bb8b-ed5e698a43d4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:03.591345 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-fb1e8361-2c07-4896-bb8b-ed5e698a43d4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 34829 microversion: 2.20 time: 0.146963 Jan 24 22:30:03.596197 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 216/435] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:30:03 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 34829 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:30:03.763432 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a9961228-252f-4feb-8f20-63096ac03771 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:03.764569 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a9961228-252f-4feb-8f20-63096ac03771 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:03.778462 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a9961228-252f-4feb-8f20-63096ac03771 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:03.778984 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a9961228-252f-4feb-8f20-63096ac03771 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:03.779852 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a9961228-252f-4feb-8f20-63096ac03771 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:03.780292 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a9961228-252f-4feb-8f20-63096ac03771 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:03.838591 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-14444a93-50c7-4f39-816b-9a1660d4e745 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:03.839791 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-14444a93-50c7-4f39-816b-9a1660d4e745 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:03.844274 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a9961228-252f-4feb-8f20-63096ac03771 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:03.846870 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-14444a93-50c7-4f39-816b-9a1660d4e745 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:03.847305 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-14444a93-50c7-4f39-816b-9a1660d4e745 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:03.848078 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-14444a93-50c7-4f39-816b-9a1660d4e745 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:03.848500 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-14444a93-50c7-4f39-816b-9a1660d4e745 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:03.851976 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a9961228-252f-4feb-8f20-63096ac03771 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 200 len: 1265 microversion: 2.1 time: 0.092062 Jan 24 22:30:03.852463 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 220/436] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:03 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:03.987897 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-14444a93-50c7-4f39-816b-9a1660d4e745 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:03.995581 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-14444a93-50c7-4f39-816b-9a1660d4e745 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.161092 Jan 24 22:30:03.996124 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 217/437] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:03 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:04.222429 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e2f83f53-dd3b-487f-9d14-62bd3405e2cb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:04.223039 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e2f83f53-dd3b-487f-9d14-62bd3405e2cb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:04.229029 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e2f83f53-dd3b-487f-9d14-62bd3405e2cb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:04.229604 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e2f83f53-dd3b-487f-9d14-62bd3405e2cb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:04.230384 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e2f83f53-dd3b-487f-9d14-62bd3405e2cb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:04.230814 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e2f83f53-dd3b-487f-9d14-62bd3405e2cb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:04.375956 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e2f83f53-dd3b-487f-9d14-62bd3405e2cb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:04.383912 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e2f83f53-dd3b-487f-9d14-62bd3405e2cb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1723 microversion: 2.1 time: 0.165483 Jan 24 22:30:04.384475 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 221/438] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:04 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:04.604014 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2f714f39-b231-4d99-91a4-c81e92576522 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:04.604928 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2f714f39-b231-4d99-91a4-c81e92576522 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:04.611708 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2f714f39-b231-4d99-91a4-c81e92576522 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:04.612157 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2f714f39-b231-4d99-91a4-c81e92576522 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:04.612930 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2f714f39-b231-4d99-91a4-c81e92576522 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:04.613377 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2f714f39-b231-4d99-91a4-c81e92576522 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:04.731555 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2f714f39-b231-4d99-91a4-c81e92576522 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 35520 microversion: 2.20 time: 0.131147 Jan 24 22:30:04.736345 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 218/439] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:30:04 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 35520 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:30:04.871016 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b8ff7ad3-678d-451b-b783-24a93e8c8bd4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:04.871680 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b8ff7ad3-678d-451b-b783-24a93e8c8bd4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:04.875553 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ce2d7fd7-f8df-4e80-adf5-e7e3a896ad9b tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2012713245", "imageRef": "4fe12948-6887-4759-900b-f3ee39409e75", "flavorRef": "452"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:04.878306 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b8ff7ad3-678d-451b-b783-24a93e8c8bd4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:04.878755 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b8ff7ad3-678d-451b-b783-24a93e8c8bd4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:04.879683 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b8ff7ad3-678d-451b-b783-24a93e8c8bd4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:04.880113 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b8ff7ad3-678d-451b-b783-24a93e8c8bd4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:04.933071 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.network.neutron [None req-ce2d7fd7-f8df-4e80-adf5-e7e3a896ad9b tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] validate_networks() for None {{(pid=116466) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:30:05.205573 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b8ff7ad3-678d-451b-b783-24a93e8c8bd4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:05.213353 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b8ff7ad3-678d-451b-b783-24a93e8c8bd4 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 200 len: 1313 microversion: 2.1 time: 0.347363 Jan 24 22:30:05.214214 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 222/440] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:04 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:05.226780 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-5bab030f-233a-4186-84e3-5fae2a725d73 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:05.227593 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-5bab030f-233a-4186-84e3-5fae2a725d73 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:05.233839 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5bab030f-233a-4186-84e3-5fae2a725d73 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:05.234292 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5bab030f-233a-4186-84e3-5fae2a725d73 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:05.235074 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5bab030f-233a-4186-84e3-5fae2a725d73 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:05.236329 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5bab030f-233a-4186-84e3-5fae2a725d73 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:05.270101 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-ce2d7fd7-f8df-4e80-adf5-e7e3a896ad9b tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Flavor limits 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:30:05.271329 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-ce2d7fd7-f8df-4e80-adf5-e7e3a896ad9b tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Image limits 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:30:05.271770 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-ce2d7fd7-f8df-4e80-adf5-e7e3a896ad9b tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Flavor pref 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:30:05.272176 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-ce2d7fd7-f8df-4e80-adf5-e7e3a896ad9b tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Image pref 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:30:05.272601 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-ce2d7fd7-f8df-4e80-adf5-e7e3a896ad9b tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:30:05.281955 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ce2d7fd7-f8df-4e80-adf5-e7e3a896ad9b tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:05.282607 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ce2d7fd7-f8df-4e80-adf5-e7e3a896ad9b tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:05.283618 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ce2d7fd7-f8df-4e80-adf5-e7e3a896ad9b tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:05.284050 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ce2d7fd7-f8df-4e80-adf5-e7e3a896ad9b tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:05.302831 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-ce2d7fd7-f8df-4e80-adf5-e7e3a896ad9b tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Getting quotas for project 5d1b7d2ae02848258a135c41a6fd52e5. Resources: {'cores', 'instances', 'ram'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:30:05.307238 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-ce2d7fd7-f8df-4e80-adf5-e7e3a896ad9b tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Getting quotas for user 21aecbf99a5548deb5b2a0581a27326b and project 5d1b7d2ae02848258a135c41a6fd52e5. Resources: {'cores', 'instances', 'ram'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:30:05.330326 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ce2d7fd7-f8df-4e80-adf5-e7e3a896ad9b tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Going to run 1 instances... {{(pid=116466) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:30:05.332778 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ce2d7fd7-f8df-4e80-adf5-e7e3a896ad9b tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fe12948-6887-4759-900b-f3ee39409e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:30:05.379235 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ce2d7fd7-f8df-4e80-adf5-e7e3a896ad9b tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507549 Jan 24 22:30:05.380085 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 219/441] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:30:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 24 22:30:05.390449 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-fbeef205-7098-42ce-8204-4b7e2a79dcb3 req-2a2bedda-8f14-4d71-a0d0-30509cdfbc12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ff8015-35d9-4196-8b1b-ea299e359e25", "tag": "8b459125-0bc6-4985-a7e9-81d9d90957c3"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:05.392662 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:30:05.392662 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:30:05.401039 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-fbeef205-7098-42ce-8204-4b7e2a79dcb3 req-2a2bedda-8f14-4d71-a0d0-30509cdfbc12 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:05.401683 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5bab030f-233a-4186-84e3-5fae2a725d73 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:05.401937 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-fbeef205-7098-42ce-8204-4b7e2a79dcb3 req-2a2bedda-8f14-4d71-a0d0-30509cdfbc12 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:05.413453 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-5bab030f-233a-4186-84e3-5fae2a725d73 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.198471 Jan 24 22:30:05.414354 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-fbeef205-7098-42ce-8204-4b7e2a79dcb3 req-2a2bedda-8f14-4d71-a0d0-30509cdfbc12 service nova] Creating event network-changed:8b459125-0bc6-4985-a7e9-81d9d90957c3 for instance a3ff8015-35d9-4196-8b1b-ea299e359e25 on hv-cinder-81322 Jan 24 22:30:05.419005 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-fbeef205-7098-42ce-8204-4b7e2a79dcb3 req-2a2bedda-8f14-4d71-a0d0-30509cdfbc12 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032604 Jan 24 22:30:05.419557 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 220/442] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:30:05.425258 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 223/443] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:05 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:05.430207 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-361a1e6a-c4d7-4936-9dda-d106f60fa26c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:05.430823 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-361a1e6a-c4d7-4936-9dda-d106f60fa26c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:05.433246 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-bcf52b50-cc46-4d30-8351-f258d17c1e44 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:05.433961 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-bcf52b50-cc46-4d30-8351-f258d17c1e44 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:05.437315 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-361a1e6a-c4d7-4936-9dda-d106f60fa26c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:05.437762 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-361a1e6a-c4d7-4936-9dda-d106f60fa26c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:05.440033 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-361a1e6a-c4d7-4936-9dda-d106f60fa26c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:05.440472 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-361a1e6a-c4d7-4936-9dda-d106f60fa26c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:05.493701 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-bcf52b50-cc46-4d30-8351-f258d17c1e44 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:05.502283 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-bcf52b50-cc46-4d30-8351-f258d17c1e44 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1215 microversion: 2.1 time: 0.080865 Jan 24 22:30:05.512065 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 221/444] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:05 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:05.593282 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-361a1e6a-c4d7-4936-9dda-d106f60fa26c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:05.603106 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-361a1e6a-c4d7-4936-9dda-d106f60fa26c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1723 microversion: 2.1 time: 0.176734 Jan 24 22:30:05.603681 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 224/445] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:05 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:05.744496 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b51e2ed6-8cd3-431d-92de-b5795c2fafba tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:05.745558 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b51e2ed6-8cd3-431d-92de-b5795c2fafba tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:05.751962 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b51e2ed6-8cd3-431d-92de-b5795c2fafba tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:05.752405 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b51e2ed6-8cd3-431d-92de-b5795c2fafba tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:05.753207 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b51e2ed6-8cd3-431d-92de-b5795c2fafba tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:05.753632 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b51e2ed6-8cd3-431d-92de-b5795c2fafba tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:05.886092 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b51e2ed6-8cd3-431d-92de-b5795c2fafba tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 36510 microversion: 2.20 time: 0.145796 Jan 24 22:30:05.886871 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 222/446] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:30:05 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 36510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:30:06.231401 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0e5eadc7-e042-49a9-a110-5c8666bc8c4f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:06.232750 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0e5eadc7-e042-49a9-a110-5c8666bc8c4f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:06.240221 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0e5eadc7-e042-49a9-a110-5c8666bc8c4f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:06.240670 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0e5eadc7-e042-49a9-a110-5c8666bc8c4f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:06.241498 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0e5eadc7-e042-49a9-a110-5c8666bc8c4f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:06.241930 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0e5eadc7-e042-49a9-a110-5c8666bc8c4f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:06.389192 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0e5eadc7-e042-49a9-a110-5c8666bc8c4f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:06.397778 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0e5eadc7-e042-49a9-a110-5c8666bc8c4f tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 200 len: 1313 microversion: 2.1 time: 0.170731 Jan 24 22:30:06.398336 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 225/447] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:06 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:06.432114 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-76483387-deb6-4f27-909b-d673b643f28a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:06.432788 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-76483387-deb6-4f27-909b-d673b643f28a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:06.440558 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-76483387-deb6-4f27-909b-d673b643f28a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:06.441007 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-76483387-deb6-4f27-909b-d673b643f28a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:06.441797 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-76483387-deb6-4f27-909b-d673b643f28a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:06.442244 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-76483387-deb6-4f27-909b-d673b643f28a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:06.519573 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-7c2a14f5-9258-4dae-8a5c-222409225d3d tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:06.520182 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-7c2a14f5-9258-4dae-8a5c-222409225d3d tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:06.526381 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7c2a14f5-9258-4dae-8a5c-222409225d3d tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:06.526693 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7c2a14f5-9258-4dae-8a5c-222409225d3d tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:06.527459 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7c2a14f5-9258-4dae-8a5c-222409225d3d tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:06.527924 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7c2a14f5-9258-4dae-8a5c-222409225d3d tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:06.595619 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7c2a14f5-9258-4dae-8a5c-222409225d3d tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:06.600307 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-76483387-deb6-4f27-909b-d673b643f28a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:06.603134 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-7c2a14f5-9258-4dae-8a5c-222409225d3d tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1267 microversion: 2.1 time: 0.087384 Jan 24 22:30:06.603710 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 226/448] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:06 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:30:06.608154 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-76483387-deb6-4f27-909b-d673b643f28a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.180047 Jan 24 22:30:06.608896 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 223/449] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:06 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:06.619737 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-170a1e72-f82b-460b-ac1e-c285fae5cc47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:06.620367 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-170a1e72-f82b-460b-ac1e-c285fae5cc47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:06.626400 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-170a1e72-f82b-460b-ac1e-c285fae5cc47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:06.626836 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-170a1e72-f82b-460b-ac1e-c285fae5cc47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:06.627623 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-170a1e72-f82b-460b-ac1e-c285fae5cc47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:06.628045 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-170a1e72-f82b-460b-ac1e-c285fae5cc47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:06.758951 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-170a1e72-f82b-460b-ac1e-c285fae5cc47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:06.767429 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-170a1e72-f82b-460b-ac1e-c285fae5cc47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1723 microversion: 2.1 time: 0.151579 Jan 24 22:30:06.767997 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 227/450] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:06 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:06.898676 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b401f7c8-a23c-4135-9921-9447e4424a69 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:06.899617 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b401f7c8-a23c-4135-9921-9447e4424a69 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:06.906373 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b401f7c8-a23c-4135-9921-9447e4424a69 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:06.907256 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b401f7c8-a23c-4135-9921-9447e4424a69 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:06.908488 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b401f7c8-a23c-4135-9921-9447e4424a69 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:06.908859 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b401f7c8-a23c-4135-9921-9447e4424a69 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:07.052146 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b401f7c8-a23c-4135-9921-9447e4424a69 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 37250 microversion: 2.20 time: 0.156926 Jan 24 22:30:07.052788 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 224/451] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:30:06 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 37250 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:30:07.414815 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-717995e9-5853-4358-9570-aa93cf242e1a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:07.415445 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-717995e9-5853-4358-9570-aa93cf242e1a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:07.422401 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-717995e9-5853-4358-9570-aa93cf242e1a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:07.422900 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-717995e9-5853-4358-9570-aa93cf242e1a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:07.424315 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-717995e9-5853-4358-9570-aa93cf242e1a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:07.424753 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-717995e9-5853-4358-9570-aa93cf242e1a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:07.559118 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-717995e9-5853-4358-9570-aa93cf242e1a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:07.566639 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-717995e9-5853-4358-9570-aa93cf242e1a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 200 len: 1313 microversion: 2.1 time: 0.155611 Jan 24 22:30:07.567199 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 228/452] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:07 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:07.621113 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ad914a30-ad07-41dd-8e50-3e37941a0826 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:07.621960 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ad914a30-ad07-41dd-8e50-3e37941a0826 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:07.625000 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-5f6b5413-1cae-4aed-8415-4a640b4d6e89 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:07.625692 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-5f6b5413-1cae-4aed-8415-4a640b4d6e89 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:07.629178 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ad914a30-ad07-41dd-8e50-3e37941a0826 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:07.629706 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ad914a30-ad07-41dd-8e50-3e37941a0826 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:07.630541 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ad914a30-ad07-41dd-8e50-3e37941a0826 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:07.631054 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ad914a30-ad07-41dd-8e50-3e37941a0826 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:07.632922 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5f6b5413-1cae-4aed-8415-4a640b4d6e89 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:07.633906 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5f6b5413-1cae-4aed-8415-4a640b4d6e89 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:07.634176 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5f6b5413-1cae-4aed-8415-4a640b4d6e89 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:07.634745 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5f6b5413-1cae-4aed-8415-4a640b4d6e89 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:07.718461 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ad914a30-ad07-41dd-8e50-3e37941a0826 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:07.726802 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ad914a30-ad07-41dd-8e50-3e37941a0826 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1273 microversion: 2.1 time: 0.109744 Jan 24 22:30:07.727596 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 225/453] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:07 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:07.783960 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b2183fa5-c155-42f0-8d8b-ff958bb89981 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:07.784472 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b2183fa5-c155-42f0-8d8b-ff958bb89981 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:07.791002 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b2183fa5-c155-42f0-8d8b-ff958bb89981 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:07.791539 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b2183fa5-c155-42f0-8d8b-ff958bb89981 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:07.792224 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b2183fa5-c155-42f0-8d8b-ff958bb89981 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:07.792641 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b2183fa5-c155-42f0-8d8b-ff958bb89981 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:07.799733 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5f6b5413-1cae-4aed-8415-4a640b4d6e89 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:07.807318 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-5f6b5413-1cae-4aed-8415-4a640b4d6e89 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.186208 Jan 24 22:30:07.808138 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 229/454] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:07 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:07.929083 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b2183fa5-c155-42f0-8d8b-ff958bb89981 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:07.937514 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b2183fa5-c155-42f0-8d8b-ff958bb89981 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1723 microversion: 2.1 time: 0.157614 Jan 24 22:30:07.938733 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 226/455] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:07 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:30:08.063908 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-338b6afa-a2d8-4b2c-b9e9-e82c6efa77bd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:08.066931 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-338b6afa-a2d8-4b2c-b9e9-e82c6efa77bd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:08.072808 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-338b6afa-a2d8-4b2c-b9e9-e82c6efa77bd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:08.073279 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-338b6afa-a2d8-4b2c-b9e9-e82c6efa77bd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:08.074069 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-338b6afa-a2d8-4b2c-b9e9-e82c6efa77bd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:08.074499 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-338b6afa-a2d8-4b2c-b9e9-e82c6efa77bd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:08.187979 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-338b6afa-a2d8-4b2c-b9e9-e82c6efa77bd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 37919 microversion: 2.20 time: 0.127770 Jan 24 22:30:08.192840 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 230/456] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:30:08 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 37919 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:30:08.583778 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-28bb5819-4ddd-48cb-9648-29d4d3252e4a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:08.584451 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-28bb5819-4ddd-48cb-9648-29d4d3252e4a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:08.591162 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-28bb5819-4ddd-48cb-9648-29d4d3252e4a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:08.591699 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-28bb5819-4ddd-48cb-9648-29d4d3252e4a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:08.592543 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-28bb5819-4ddd-48cb-9648-29d4d3252e4a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:08.593069 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-28bb5819-4ddd-48cb-9648-29d4d3252e4a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:08.702277 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-4a60cdb1-fd6a-4b80-978a-22589da71663 req-471f94d7-fc19-4e34-8da6-b22faffe30c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96169450-a083-4ea2-bf32-f61642531005", "tag": "552da456-962b-427d-9564-afd0551bb574"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:08.704902 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:30:08.704902 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:30:08.722213 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-4a60cdb1-fd6a-4b80-978a-22589da71663 req-471f94d7-fc19-4e34-8da6-b22faffe30c8 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:08.723040 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-4a60cdb1-fd6a-4b80-978a-22589da71663 req-471f94d7-fc19-4e34-8da6-b22faffe30c8 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:08.738713 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-4a60cdb1-fd6a-4b80-978a-22589da71663 req-471f94d7-fc19-4e34-8da6-b22faffe30c8 service nova] Creating event network-changed:552da456-962b-427d-9564-afd0551bb574 for instance 96169450-a083-4ea2-bf32-f61642531005 on hv-cinder-81322 Jan 24 22:30:08.744715 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-4a60cdb1-fd6a-4b80-978a-22589da71663 req-471f94d7-fc19-4e34-8da6-b22faffe30c8 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048369 Jan 24 22:30:08.745502 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 231/457] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:30:08.750362 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-28bb5819-4ddd-48cb-9648-29d4d3252e4a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:08.752329 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-cfd80846-781c-4144-85d3-21eeb89327a2 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:08.753116 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-cfd80846-781c-4144-85d3-21eeb89327a2 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:08.759722 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cfd80846-781c-4144-85d3-21eeb89327a2 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:08.759859 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-28bb5819-4ddd-48cb-9648-29d4d3252e4a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 200 len: 1313 microversion: 2.1 time: 0.179850 Jan 24 22:30:08.760699 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cfd80846-781c-4144-85d3-21eeb89327a2 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:08.760826 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 227/458] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:08 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:08.761361 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cfd80846-781c-4144-85d3-21eeb89327a2 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:08.762031 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cfd80846-781c-4144-85d3-21eeb89327a2 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:08.826762 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-67347702-5633-42c2-bdc4-cc4647707e51 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:08.827762 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-67347702-5633-42c2-bdc4-cc4647707e51 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:08.836662 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-67347702-5633-42c2-bdc4-cc4647707e51 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:08.837631 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-67347702-5633-42c2-bdc4-cc4647707e51 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:08.838623 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-67347702-5633-42c2-bdc4-cc4647707e51 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:08.839045 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-67347702-5633-42c2-bdc4-cc4647707e51 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:08.944045 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-cfd80846-781c-4144-85d3-21eeb89327a2 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:08.953321 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-cfd80846-781c-4144-85d3-21eeb89327a2 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1315 microversion: 2.1 time: 0.206203 Jan 24 22:30:08.956187 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 232/459] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:08 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:08.958716 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f19c56e3-fbb3-497f-a126-ba0f47c269f5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:08.959312 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-f19c56e3-fbb3-497f-a126-ba0f47c269f5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:08.965097 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f19c56e3-fbb3-497f-a126-ba0f47c269f5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:08.965530 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f19c56e3-fbb3-497f-a126-ba0f47c269f5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:08.966474 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f19c56e3-fbb3-497f-a126-ba0f47c269f5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:08.966904 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f19c56e3-fbb3-497f-a126-ba0f47c269f5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:09.019049 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-67347702-5633-42c2-bdc4-cc4647707e51 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:09.028386 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-67347702-5633-42c2-bdc4-cc4647707e51 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.205199 Jan 24 22:30:09.029210 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 228/460] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:08 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:09.110840 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-f19c56e3-fbb3-497f-a126-ba0f47c269f5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:09.118697 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-f19c56e3-fbb3-497f-a126-ba0f47c269f5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1723 microversion: 2.1 time: 0.163453 Jan 24 22:30:09.119304 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 233/461] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:08 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:09.199871 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-04f15a1a-15e0-40d4-b365-a26bd284e3af tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:09.200895 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-04f15a1a-15e0-40d4-b365-a26bd284e3af tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:09.207097 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-04f15a1a-15e0-40d4-b365-a26bd284e3af tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:09.208346 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-04f15a1a-15e0-40d4-b365-a26bd284e3af tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:09.209450 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-04f15a1a-15e0-40d4-b365-a26bd284e3af tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:09.209875 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-04f15a1a-15e0-40d4-b365-a26bd284e3af tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:09.382454 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-04f15a1a-15e0-40d4-b365-a26bd284e3af tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 38158 microversion: 2.20 time: 0.186122 Jan 24 22:30:09.383100 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 229/462] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:30:09 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 38158 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:30:09.777728 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-897f6d9b-3e19-4976-9e99-47164109d979 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:09.778329 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-897f6d9b-3e19-4976-9e99-47164109d979 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:09.785622 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-897f6d9b-3e19-4976-9e99-47164109d979 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:09.786063 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-897f6d9b-3e19-4976-9e99-47164109d979 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:09.786854 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-897f6d9b-3e19-4976-9e99-47164109d979 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:09.787275 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-897f6d9b-3e19-4976-9e99-47164109d979 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:09.932028 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-897f6d9b-3e19-4976-9e99-47164109d979 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:09.941588 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-897f6d9b-3e19-4976-9e99-47164109d979 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 200 len: 1313 microversion: 2.1 time: 0.167912 Jan 24 22:30:09.942164 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 234/463] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:09 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:09.970793 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-5edcb9b6-44c7-4d67-8263-6df62d15506a tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:09.971494 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-5edcb9b6-44c7-4d67-8263-6df62d15506a tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:09.978421 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5edcb9b6-44c7-4d67-8263-6df62d15506a tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:09.978873 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5edcb9b6-44c7-4d67-8263-6df62d15506a tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:09.979659 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5edcb9b6-44c7-4d67-8263-6df62d15506a tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:09.980093 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5edcb9b6-44c7-4d67-8263-6df62d15506a tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:10.046156 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ae76f9c0-32a8-4ec9-9d0d-8c599122b921 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:10.047089 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ae76f9c0-32a8-4ec9-9d0d-8c599122b921 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:10.058240 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ae76f9c0-32a8-4ec9-9d0d-8c599122b921 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:10.058874 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ae76f9c0-32a8-4ec9-9d0d-8c599122b921 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:10.059687 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ae76f9c0-32a8-4ec9-9d0d-8c599122b921 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:10.060111 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ae76f9c0-32a8-4ec9-9d0d-8c599122b921 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:10.152893 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-5edcb9b6-44c7-4d67-8263-6df62d15506a tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:10.160516 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-5edcb9b6-44c7-4d67-8263-6df62d15506a tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1315 microversion: 2.1 time: 0.193921 Jan 24 22:30:10.161285 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 230/464] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:09 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:10.165330 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-bcd6fa89-0407-4641-8de5-6df1023576fc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:10.165959 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-bcd6fa89-0407-4641-8de5-6df1023576fc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:10.172748 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bcd6fa89-0407-4641-8de5-6df1023576fc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:10.173313 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bcd6fa89-0407-4641-8de5-6df1023576fc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:10.176894 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bcd6fa89-0407-4641-8de5-6df1023576fc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:10.177364 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bcd6fa89-0407-4641-8de5-6df1023576fc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:10.229283 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ae76f9c0-32a8-4ec9-9d0d-8c599122b921 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:10.236888 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ae76f9c0-32a8-4ec9-9d0d-8c599122b921 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.195155 Jan 24 22:30:10.237554 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 235/465] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:10 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:30:10.260516 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a070da6f-3928-4374-853f-96fe82e614c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:10.261117 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a070da6f-3928-4374-853f-96fe82e614c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:10.269483 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a070da6f-3928-4374-853f-96fe82e614c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:10.269938 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a070da6f-3928-4374-853f-96fe82e614c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:10.270684 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a070da6f-3928-4374-853f-96fe82e614c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:10.271114 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a070da6f-3928-4374-853f-96fe82e614c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:10.316120 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-bcd6fa89-0407-4641-8de5-6df1023576fc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:10.326231 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-bcd6fa89-0407-4641-8de5-6df1023576fc tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1723 microversion: 2.1 time: 0.164123 Jan 24 22:30:10.326850 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 231/466] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:10 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:10.353780 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-a070da6f-3928-4374-853f-96fe82e614c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lazy-loading 'services' on Instance uuid 60a6892a-6bcf-48a9-ba54-e2f6fce165c8 {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:30:10.395029 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e5f9b4ed-0bbd-4b4d-84c0-2b371d21c407 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:10.396035 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e5f9b4ed-0bbd-4b4d-84c0-2b371d21c407 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:10.402154 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e5f9b4ed-0bbd-4b4d-84c0-2b371d21c407 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:10.402593 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e5f9b4ed-0bbd-4b4d-84c0-2b371d21c407 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:10.403356 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e5f9b4ed-0bbd-4b4d-84c0-2b371d21c407 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:10.403781 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e5f9b4ed-0bbd-4b4d-84c0-2b371d21c407 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:10.437505 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a070da6f-3928-4374-853f-96fe82e614c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "DELETE /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8/os-volume_attachments/a92711b5-80fa-4e95-bf70-f547e78d3f4e" status: 202 len: 0 microversion: 2.1 time: 0.180152 Jan 24 22:30:10.438250 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 236/467] 10.222.0.84 () {58 vars in 1415 bytes} [Mon Jan 24 22:30:10 2022] DELETE /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8/os-volume_attachments/a92711b5-80fa-4e95-bf70-f547e78d3f4e => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:30:10.447179 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-52ca5937-86ec-4b0e-8437-641515af0f7f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:10.448278 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-52ca5937-86ec-4b0e-8437-641515af0f7f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:10.464159 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-52ca5937-86ec-4b0e-8437-641515af0f7f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:10.464809 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-52ca5937-86ec-4b0e-8437-641515af0f7f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:10.465696 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-52ca5937-86ec-4b0e-8437-641515af0f7f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:10.466170 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-52ca5937-86ec-4b0e-8437-641515af0f7f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:10.498058 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-52ca5937-86ec-4b0e-8437-641515af0f7f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054616 Jan 24 22:30:10.498529 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 237/468] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:30:10 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:30:10.540163 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e5f9b4ed-0bbd-4b4d-84c0-2b371d21c407 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 38172 microversion: 2.20 time: 0.148692 Jan 24 22:30:10.540826 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 232/469] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:30:10 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 38172 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:30:10.958648 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-45ed4b93-8dfd-499c-a640-45a692b4be7c tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:10.959314 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-45ed4b93-8dfd-499c-a640-45a692b4be7c tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:10.966349 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-45ed4b93-8dfd-499c-a640-45a692b4be7c tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:10.966797 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-45ed4b93-8dfd-499c-a640-45a692b4be7c tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:10.967569 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-45ed4b93-8dfd-499c-a640-45a692b4be7c tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:10.968002 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-45ed4b93-8dfd-499c-a640-45a692b4be7c tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:11.109097 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-45ed4b93-8dfd-499c-a640-45a692b4be7c tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:11.116753 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-45ed4b93-8dfd-499c-a640-45a692b4be7c tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 200 len: 1313 microversion: 2.1 time: 0.162303 Jan 24 22:30:11.117346 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 238/470] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:10 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:11.181813 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e278dc9d-10b9-422d-b3c9-9c5952189d72 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:11.182785 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e278dc9d-10b9-422d-b3c9-9c5952189d72 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:11.191971 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e278dc9d-10b9-422d-b3c9-9c5952189d72 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:11.192418 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e278dc9d-10b9-422d-b3c9-9c5952189d72 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:11.193233 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e278dc9d-10b9-422d-b3c9-9c5952189d72 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:11.193664 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e278dc9d-10b9-422d-b3c9-9c5952189d72 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:11.258214 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-61df5ea1-fb2a-4d7b-90ed-45a6f03ea1b5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:11.258960 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-61df5ea1-fb2a-4d7b-90ed-45a6f03ea1b5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:11.266297 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-61df5ea1-fb2a-4d7b-90ed-45a6f03ea1b5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:11.266847 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-61df5ea1-fb2a-4d7b-90ed-45a6f03ea1b5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:11.268610 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-61df5ea1-fb2a-4d7b-90ed-45a6f03ea1b5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:11.269076 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-61df5ea1-fb2a-4d7b-90ed-45a6f03ea1b5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:11.357533 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e278dc9d-10b9-422d-b3c9-9c5952189d72 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:11.364956 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e278dc9d-10b9-422d-b3c9-9c5952189d72 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1315 microversion: 2.1 time: 0.190132 Jan 24 22:30:11.365556 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 233/471] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:11 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:11.369745 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1779be25-9521-400d-8ef4-88fda3d31057 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:11.370337 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-1779be25-9521-400d-8ef4-88fda3d31057 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:11.387923 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1779be25-9521-400d-8ef4-88fda3d31057 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:11.388905 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1779be25-9521-400d-8ef4-88fda3d31057 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:11.389765 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1779be25-9521-400d-8ef4-88fda3d31057 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:11.390207 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1779be25-9521-400d-8ef4-88fda3d31057 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:11.422748 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-61df5ea1-fb2a-4d7b-90ed-45a6f03ea1b5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:11.430901 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-61df5ea1-fb2a-4d7b-90ed-45a6f03ea1b5 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.177225 Jan 24 22:30:11.431674 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 239/472] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:11 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:11.510163 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b51f0e30-eae2-4541-bc40-70913afb68c4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:11.511037 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b51f0e30-eae2-4541-bc40-70913afb68c4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:11.517954 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b51f0e30-eae2-4541-bc40-70913afb68c4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:11.518416 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b51f0e30-eae2-4541-bc40-70913afb68c4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:11.519196 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b51f0e30-eae2-4541-bc40-70913afb68c4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:11.519627 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b51f0e30-eae2-4541-bc40-70913afb68c4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:11.545064 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-1779be25-9521-400d-8ef4-88fda3d31057 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:11.552658 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b51f0e30-eae2-4541-bc40-70913afb68c4 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046395 Jan 24 22:30:11.553543 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 240/473] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:30:11 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:30:11.554401 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-1779be25-9521-400d-8ef4-88fda3d31057 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1723 microversion: 2.1 time: 0.187811 Jan 24 22:30:11.554973 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 234/474] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:11 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:11.557843 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9b7d2c2a-5557-462c-9acb-46c137a388e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:11.558717 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9b7d2c2a-5557-462c-9acb-46c137a388e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:11.564851 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9b7d2c2a-5557-462c-9acb-46c137a388e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:11.565320 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9b7d2c2a-5557-462c-9acb-46c137a388e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:11.566084 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9b7d2c2a-5557-462c-9acb-46c137a388e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:11.566509 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9b7d2c2a-5557-462c-9acb-46c137a388e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:11.694254 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9b7d2c2a-5557-462c-9acb-46c137a388e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 200 len: 38295 microversion: 2.20 time: 0.139045 Jan 24 22:30:11.695763 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 241/475] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:30:11 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 38295 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:30:11.708742 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e370af8e-aa86-47fb-9394-52c44d6ccd4c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:11.709261 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e370af8e-aa86-47fb-9394-52c44d6ccd4c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:11.715842 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e370af8e-aa86-47fb-9394-52c44d6ccd4c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:11.716287 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e370af8e-aa86-47fb-9394-52c44d6ccd4c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:11.717110 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e370af8e-aa86-47fb-9394-52c44d6ccd4c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:11.717539 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e370af8e-aa86-47fb-9394-52c44d6ccd4c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:11.740803 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e370af8e-aa86-47fb-9394-52c44d6ccd4c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/ips" status: 200 len: 151 microversion: 2.20 time: 0.035970 Jan 24 22:30:11.741406 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 235/476] 10.222.0.84 () {60 vars in 1288 bytes} [Mon Jan 24 22:30:11 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:30:12.137604 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-22ba919e-c5ca-439a-ac88-a72233a6f024 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:12.138603 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-22ba919e-c5ca-439a-ac88-a72233a6f024 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:12.146009 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-22ba919e-c5ca-439a-ac88-a72233a6f024 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:12.146449 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-22ba919e-c5ca-439a-ac88-a72233a6f024 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:12.147222 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-22ba919e-c5ca-439a-ac88-a72233a6f024 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:12.147652 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-22ba919e-c5ca-439a-ac88-a72233a6f024 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:12.244361 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-d41c28b9-4538-469e-8dbe-b600336ad7d1 req-af8f4524-ca13-460f-ad79-8e1231192678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ff8015-35d9-4196-8b1b-ea299e359e25", "name": "network-vif-plugged", "status": "completed", "tag": "8b459125-0bc6-4985-a7e9-81d9d90957c3"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:12.246078 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:30:12.246078 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:30:12.253875 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-d41c28b9-4538-469e-8dbe-b600336ad7d1 req-af8f4524-ca13-460f-ad79-8e1231192678 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:12.254294 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-d41c28b9-4538-469e-8dbe-b600336ad7d1 req-af8f4524-ca13-460f-ad79-8e1231192678 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:12.268116 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-d41c28b9-4538-469e-8dbe-b600336ad7d1 req-af8f4524-ca13-460f-ad79-8e1231192678 service nova] Creating event network-vif-plugged:8b459125-0bc6-4985-a7e9-81d9d90957c3 for instance a3ff8015-35d9-4196-8b1b-ea299e359e25 on hv-cinder-81322 Jan 24 22:30:12.272958 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-d41c28b9-4538-469e-8dbe-b600336ad7d1 req-af8f4524-ca13-460f-ad79-8e1231192678 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032182 Jan 24 22:30:12.273781 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 236/477] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:30:12.281091 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-22ba919e-c5ca-439a-ac88-a72233a6f024 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:12.289193 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-22ba919e-c5ca-439a-ac88-a72233a6f024 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 200 len: 1313 microversion: 2.1 time: 0.155449 Jan 24 22:30:12.289758 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 242/478] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:12 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:12.382173 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-376ee5cc-5a33-4f5c-8368-9101a3476086 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:12.382948 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-376ee5cc-5a33-4f5c-8368-9101a3476086 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:12.390030 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-376ee5cc-5a33-4f5c-8368-9101a3476086 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:12.390612 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-376ee5cc-5a33-4f5c-8368-9101a3476086 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:12.391466 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-376ee5cc-5a33-4f5c-8368-9101a3476086 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:12.392088 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-376ee5cc-5a33-4f5c-8368-9101a3476086 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:12.447689 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-59b5a54c-dd24-43f2-b897-14a927c65e32 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:12.448300 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-59b5a54c-dd24-43f2-b897-14a927c65e32 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:12.455410 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-59b5a54c-dd24-43f2-b897-14a927c65e32 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:12.455861 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-59b5a54c-dd24-43f2-b897-14a927c65e32 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:12.456673 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-59b5a54c-dd24-43f2-b897-14a927c65e32 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:12.457176 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-59b5a54c-dd24-43f2-b897-14a927c65e32 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:12.556522 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-376ee5cc-5a33-4f5c-8368-9101a3476086 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:12.565929 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-376ee5cc-5a33-4f5c-8368-9101a3476086 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1315 microversion: 2.1 time: 0.187657 Jan 24 22:30:12.575511 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 237/479] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:12 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:12.575511 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-63b16001-ba88-4176-b8c7-51a5a02ebe73 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:12.575511 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-63b16001-ba88-4176-b8c7-51a5a02ebe73 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:12.579121 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-63b16001-ba88-4176-b8c7-51a5a02ebe73 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:12.579730 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-63b16001-ba88-4176-b8c7-51a5a02ebe73 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:12.580758 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-63b16001-ba88-4176-b8c7-51a5a02ebe73 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:12.581269 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-63b16001-ba88-4176-b8c7-51a5a02ebe73 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:12.614061 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-63b16001-ba88-4176-b8c7-51a5a02ebe73 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045966 Jan 24 22:30:12.614648 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 238/480] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:30:12 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 22:30:12.619050 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-59b5a54c-dd24-43f2-b897-14a927c65e32 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:12.619305 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-d409cb42-3a6c-4875-9f9f-e019fec56b42 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:12.619730 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d409cb42-3a6c-4875-9f9f-e019fec56b42 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:12.626144 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d409cb42-3a6c-4875-9f9f-e019fec56b42 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:12.626801 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d409cb42-3a6c-4875-9f9f-e019fec56b42 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:12.627264 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-59b5a54c-dd24-43f2-b897-14a927c65e32 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.183237 Jan 24 22:30:12.627770 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d409cb42-3a6c-4875-9f9f-e019fec56b42 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:12.627883 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 243/481] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:12 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:30:12.628207 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d409cb42-3a6c-4875-9f9f-e019fec56b42 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:12.760436 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d409cb42-3a6c-4875-9f9f-e019fec56b42 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:12.769543 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-d409cb42-3a6c-4875-9f9f-e019fec56b42 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1723 microversion: 2.1 time: 0.153916 Jan 24 22:30:12.770111 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 239/482] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:12 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:13.306538 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a6f88d86-e8d9-4df4-89e4-0abe75f4cc70 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:13.307066 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a6f88d86-e8d9-4df4-89e4-0abe75f4cc70 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:13.314125 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a6f88d86-e8d9-4df4-89e4-0abe75f4cc70 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:13.314575 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a6f88d86-e8d9-4df4-89e4-0abe75f4cc70 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:13.315342 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a6f88d86-e8d9-4df4-89e4-0abe75f4cc70 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:13.315766 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a6f88d86-e8d9-4df4-89e4-0abe75f4cc70 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:13.446607 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a6f88d86-e8d9-4df4-89e4-0abe75f4cc70 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:13.454327 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a6f88d86-e8d9-4df4-89e4-0abe75f4cc70 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 200 len: 1313 microversion: 2.1 time: 0.151613 Jan 24 22:30:13.454917 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 244/483] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:13 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:13.583438 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-bb6854ac-1ca8-4b0e-bfdd-888e1d8f28fe tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:13.584002 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-bb6854ac-1ca8-4b0e-bfdd-888e1d8f28fe tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:13.590648 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bb6854ac-1ca8-4b0e-bfdd-888e1d8f28fe tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:13.591095 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bb6854ac-1ca8-4b0e-bfdd-888e1d8f28fe tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:13.591861 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bb6854ac-1ca8-4b0e-bfdd-888e1d8f28fe tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:13.592292 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bb6854ac-1ca8-4b0e-bfdd-888e1d8f28fe tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:13.645367 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ec322a60-2e78-4910-b0ff-4baf98689f1d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:13.646340 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ec322a60-2e78-4910-b0ff-4baf98689f1d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:13.652601 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ec322a60-2e78-4910-b0ff-4baf98689f1d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:13.653308 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ec322a60-2e78-4910-b0ff-4baf98689f1d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:13.654324 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ec322a60-2e78-4910-b0ff-4baf98689f1d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:13.654914 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ec322a60-2e78-4910-b0ff-4baf98689f1d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:13.753720 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-bb6854ac-1ca8-4b0e-bfdd-888e1d8f28fe tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:13.761496 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-bb6854ac-1ca8-4b0e-bfdd-888e1d8f28fe tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1315 microversion: 2.1 time: 0.181839 Jan 24 22:30:13.762201 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 240/484] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:13 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:13.786607 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-51a950b5-710c-43f7-a5ab-d5ccfaa4f3d6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:13.787218 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-51a950b5-710c-43f7-a5ab-d5ccfaa4f3d6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:13.793308 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-51a950b5-710c-43f7-a5ab-d5ccfaa4f3d6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:13.793763 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-51a950b5-710c-43f7-a5ab-d5ccfaa4f3d6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:13.797491 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-51a950b5-710c-43f7-a5ab-d5ccfaa4f3d6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:13.797952 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-51a950b5-710c-43f7-a5ab-d5ccfaa4f3d6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:13.816351 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ec322a60-2e78-4910-b0ff-4baf98689f1d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:13.824330 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ec322a60-2e78-4910-b0ff-4baf98689f1d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.183913 Jan 24 22:30:13.824915 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 245/485] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:13 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:13.829609 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-47345d88-6a59-4c50-9429-f9048ede3773 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:13.830279 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-47345d88-6a59-4c50-9429-f9048ede3773 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:13.836299 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-47345d88-6a59-4c50-9429-f9048ede3773 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:13.836672 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-47345d88-6a59-4c50-9429-f9048ede3773 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:13.837466 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-47345d88-6a59-4c50-9429-f9048ede3773 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:13.837891 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-47345d88-6a59-4c50-9429-f9048ede3773 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:13.862285 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-47345d88-6a59-4c50-9429-f9048ede3773 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Going to try to terminate instance {{(pid=116467) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:30:13.933028 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-51a950b5-710c-43f7-a5ab-d5ccfaa4f3d6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:13.942255 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-51a950b5-710c-43f7-a5ab-d5ccfaa4f3d6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1723 microversion: 2.1 time: 0.159212 Jan 24 22:30:13.943673 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 241/486] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:13 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:13.950512 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-47345d88-6a59-4c50-9429-f9048ede3773 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "DELETE /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 204 len: 0 microversion: 2.1 time: 0.124147 Jan 24 22:30:13.951190 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 246/487] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:30:13 2022] DELETE /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:30:13.960590 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c2e0c76c-3d9c-409f-b15a-a3b6ef575413 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:13.961229 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c2e0c76c-3d9c-409f-b15a-a3b6ef575413 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:13.967067 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c2e0c76c-3d9c-409f-b15a-a3b6ef575413 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:13.967509 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c2e0c76c-3d9c-409f-b15a-a3b6ef575413 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:13.968275 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c2e0c76c-3d9c-409f-b15a-a3b6ef575413 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:13.968704 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c2e0c76c-3d9c-409f-b15a-a3b6ef575413 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:14.105108 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c2e0c76c-3d9c-409f-b15a-a3b6ef575413 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:14.115264 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c2e0c76c-3d9c-409f-b15a-a3b6ef575413 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1513 microversion: 2.1 time: 0.158734 Jan 24 22:30:14.115599 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 242/488] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:13 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:14.200600 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-514adb24-f719-4601-bd2f-c58edda82751 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:14.201253 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-514adb24-f719-4601-bd2f-c58edda82751 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:14.207223 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-514adb24-f719-4601-bd2f-c58edda82751 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:14.207911 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-514adb24-f719-4601-bd2f-c58edda82751 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:14.208778 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-514adb24-f719-4601-bd2f-c58edda82751 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:14.209110 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-514adb24-f719-4601-bd2f-c58edda82751 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:14.231789 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-514adb24-f719-4601-bd2f-c58edda82751 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lazy-loading 'flavor' on Instance uuid 5995cfc4-026f-45ae-a918-0bc8f1bdc025 {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:30:14.472099 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-81833090-a15a-4005-a4ab-101036743d43 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:14.472749 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-81833090-a15a-4005-a4ab-101036743d43 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:14.480301 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-81833090-a15a-4005-a4ab-101036743d43 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:14.480850 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-81833090-a15a-4005-a4ab-101036743d43 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:14.481703 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-81833090-a15a-4005-a4ab-101036743d43 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:14.482133 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-81833090-a15a-4005-a4ab-101036743d43 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:14.531063 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-514adb24-f719-4601-bd2f-c58edda82751 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 202 len: 0 microversion: 2.20 time: 0.334392 Jan 24 22:30:14.534724 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 247/489] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:30:14 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:30:14.539874 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b37aee3e-1b2c-4505-a364-dc493933ed28 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:14.540807 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b37aee3e-1b2c-4505-a364-dc493933ed28 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:14.549393 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b37aee3e-1b2c-4505-a364-dc493933ed28 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:14.549825 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b37aee3e-1b2c-4505-a364-dc493933ed28 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:14.550605 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b37aee3e-1b2c-4505-a364-dc493933ed28 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:14.551038 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b37aee3e-1b2c-4505-a364-dc493933ed28 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:14.651527 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-81833090-a15a-4005-a4ab-101036743d43 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:14.659262 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-81833090-a15a-4005-a4ab-101036743d43 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 200 len: 1496 microversion: 2.1 time: 0.191810 Jan 24 22:30:14.659869 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 243/490] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:14 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 1496 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:30:14.714393 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b37aee3e-1b2c-4505-a364-dc493933ed28 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:14.723205 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b37aee3e-1b2c-4505-a364-dc493933ed28 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:14.724753 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b37aee3e-1b2c-4505-a364-dc493933ed28 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:14.725944 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b37aee3e-1b2c-4505-a364-dc493933ed28 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.189968 Jan 24 22:30:14.726521 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 248/491] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:14 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:30:14.779715 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8e4f5de9-b885-4b19-ade8-061878b7fa97 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:14.780373 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8e4f5de9-b885-4b19-ade8-061878b7fa97 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:14.787563 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8e4f5de9-b885-4b19-ade8-061878b7fa97 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:14.788001 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8e4f5de9-b885-4b19-ade8-061878b7fa97 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:14.788778 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8e4f5de9-b885-4b19-ade8-061878b7fa97 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:14.789248 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8e4f5de9-b885-4b19-ade8-061878b7fa97 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:14.840748 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-658ea5d8-ddad-4cba-bd52-49e8f5acd500 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:14.841385 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-658ea5d8-ddad-4cba-bd52-49e8f5acd500 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:14.847770 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-658ea5d8-ddad-4cba-bd52-49e8f5acd500 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:14.848217 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-658ea5d8-ddad-4cba-bd52-49e8f5acd500 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:14.849003 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-658ea5d8-ddad-4cba-bd52-49e8f5acd500 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:14.849435 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-658ea5d8-ddad-4cba-bd52-49e8f5acd500 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:14.963351 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-8e4f5de9-b885-4b19-ade8-061878b7fa97 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:14.971568 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8e4f5de9-b885-4b19-ade8-061878b7fa97 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1315 microversion: 2.1 time: 0.195146 Jan 24 22:30:14.972142 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 244/492] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:14 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:14.984376 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-cf2c86dd-98de-4330-9e15-105ddb821d63 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:14.985006 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-cf2c86dd-98de-4330-9e15-105ddb821d63 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:14.991433 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cf2c86dd-98de-4330-9e15-105ddb821d63 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:14.991887 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cf2c86dd-98de-4330-9e15-105ddb821d63 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:14.992682 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cf2c86dd-98de-4330-9e15-105ddb821d63 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:14.993147 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cf2c86dd-98de-4330-9e15-105ddb821d63 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:15.021683 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-658ea5d8-ddad-4cba-bd52-49e8f5acd500 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:15.028866 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-658ea5d8-ddad-4cba-bd52-49e8f5acd500 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.191817 Jan 24 22:30:15.029464 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 249/493] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:14 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:15.132230 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-25e6cd9b-c73f-4f79-9f12-3ac3c19191c9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:15.132841 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-25e6cd9b-c73f-4f79-9f12-3ac3c19191c9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:15.139280 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-25e6cd9b-c73f-4f79-9f12-3ac3c19191c9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:15.139728 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-25e6cd9b-c73f-4f79-9f12-3ac3c19191c9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:15.140517 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-25e6cd9b-c73f-4f79-9f12-3ac3c19191c9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:15.140949 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-25e6cd9b-c73f-4f79-9f12-3ac3c19191c9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:15.380385 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-cf2c86dd-98de-4330-9e15-105ddb821d63 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:15.389229 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-cf2c86dd-98de-4330-9e15-105ddb821d63 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1723 microversion: 2.1 time: 0.415406 Jan 24 22:30:15.409070 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 245/494] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:14 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1723 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:15.414065 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c51966c1-caf1-4df2-950f-2e5b957b4877 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:15.414575 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c51966c1-caf1-4df2-950f-2e5b957b4877 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:15.420370 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c51966c1-caf1-4df2-950f-2e5b957b4877 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:15.420811 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c51966c1-caf1-4df2-950f-2e5b957b4877 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:15.421618 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c51966c1-caf1-4df2-950f-2e5b957b4877 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:15.422043 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c51966c1-caf1-4df2-950f-2e5b957b4877 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:15.440264 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-25e6cd9b-c73f-4f79-9f12-3ac3c19191c9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:15.446871 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c51966c1-caf1-4df2-950f-2e5b957b4877 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Going to try to terminate instance {{(pid=116466) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:30:15.447735 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-25e6cd9b-c73f-4f79-9f12-3ac3c19191c9 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1513 microversion: 2.1 time: 0.319467 Jan 24 22:30:15.448319 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 250/495] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:15 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1513 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:15.528093 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c51966c1-caf1-4df2-950f-2e5b957b4877 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "DELETE /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 204 len: 0 microversion: 2.1 time: 0.117268 Jan 24 22:30:15.528674 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 246/496] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:30:15 2022] DELETE /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:30:15.537094 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3f2bb9a3-c6bd-4dd4-a4a8-4cb552a10121 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:15.537706 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-3f2bb9a3-c6bd-4dd4-a4a8-4cb552a10121 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:15.543800 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3f2bb9a3-c6bd-4dd4-a4a8-4cb552a10121 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:15.544232 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3f2bb9a3-c6bd-4dd4-a4a8-4cb552a10121 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:15.545019 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3f2bb9a3-c6bd-4dd4-a4a8-4cb552a10121 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:15.545455 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3f2bb9a3-c6bd-4dd4-a4a8-4cb552a10121 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:15.681529 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3f2bb9a3-c6bd-4dd4-a4a8-4cb552a10121 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:15.691787 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-3f2bb9a3-c6bd-4dd4-a4a8-4cb552a10121 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 200 len: 1502 microversion: 2.1 time: 0.158535 Jan 24 22:30:15.692323 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 251/497] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:15 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:15.748510 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-52f7bd48-8a6b-4a48-8243-27e75a0d2fa3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:15.749219 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-52f7bd48-8a6b-4a48-8243-27e75a0d2fa3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:15.756046 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-52f7bd48-8a6b-4a48-8243-27e75a0d2fa3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:15.756488 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-52f7bd48-8a6b-4a48-8243-27e75a0d2fa3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:15.757298 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-52f7bd48-8a6b-4a48-8243-27e75a0d2fa3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:15.757726 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-52f7bd48-8a6b-4a48-8243-27e75a0d2fa3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:15.898937 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-52f7bd48-8a6b-4a48-8243-27e75a0d2fa3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:15.907873 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-52f7bd48-8a6b-4a48-8243-27e75a0d2fa3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:15.909711 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-52f7bd48-8a6b-4a48-8243-27e75a0d2fa3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:15.910864 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-52f7bd48-8a6b-4a48-8243-27e75a0d2fa3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.166511 Jan 24 22:30:15.911432 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 247/498] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:15 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:15.989813 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-88c0007d-7c04-42e5-a71a-393d7aaaf41c tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:15.990419 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-88c0007d-7c04-42e5-a71a-393d7aaaf41c tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:15.998513 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-88c0007d-7c04-42e5-a71a-393d7aaaf41c tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:15.998953 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-88c0007d-7c04-42e5-a71a-393d7aaaf41c tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:15.999796 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-88c0007d-7c04-42e5-a71a-393d7aaaf41c tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:16.000231 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-88c0007d-7c04-42e5-a71a-393d7aaaf41c tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:16.050539 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-00a19579-6e3f-40c9-83be-a44f0cc35b69 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:16.051996 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-00a19579-6e3f-40c9-83be-a44f0cc35b69 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:16.060027 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-00a19579-6e3f-40c9-83be-a44f0cc35b69 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:16.060747 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-00a19579-6e3f-40c9-83be-a44f0cc35b69 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:16.061781 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-00a19579-6e3f-40c9-83be-a44f0cc35b69 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:16.062209 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-00a19579-6e3f-40c9-83be-a44f0cc35b69 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:16.210369 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-88c0007d-7c04-42e5-a71a-393d7aaaf41c tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:16.218505 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-88c0007d-7c04-42e5-a71a-393d7aaaf41c tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1315 microversion: 2.1 time: 0.232600 Jan 24 22:30:16.225364 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 252/499] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:15 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:16.260462 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-00a19579-6e3f-40c9-83be-a44f0cc35b69 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:16.269625 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-00a19579-6e3f-40c9-83be-a44f0cc35b69 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.226323 Jan 24 22:30:16.270203 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 248/500] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:16 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:16.408601 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b43e9624-5890-4d2a-8798-c6adad56bcaf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:16.409202 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b43e9624-5890-4d2a-8798-c6adad56bcaf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:16.416193 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b43e9624-5890-4d2a-8798-c6adad56bcaf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:16.416658 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b43e9624-5890-4d2a-8798-c6adad56bcaf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:16.417479 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b43e9624-5890-4d2a-8798-c6adad56bcaf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:16.417890 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b43e9624-5890-4d2a-8798-c6adad56bcaf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:16.464631 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-98927c3c-b32c-4722-8bcc-4137178dfd7a tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:16.465374 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-98927c3c-b32c-4722-8bcc-4137178dfd7a tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:16.471424 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-98927c3c-b32c-4722-8bcc-4137178dfd7a tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:16.471979 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-98927c3c-b32c-4722-8bcc-4137178dfd7a tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:16.472876 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-98927c3c-b32c-4722-8bcc-4137178dfd7a tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:16.473427 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-98927c3c-b32c-4722-8bcc-4137178dfd7a tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:16.590040 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b43e9624-5890-4d2a-8798-c6adad56bcaf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:16.598928 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b43e9624-5890-4d2a-8798-c6adad56bcaf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1723 microversion: 2.1 time: 0.194818 Jan 24 22:30:16.601676 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 253/501] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:16 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:16.649583 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-98927c3c-b32c-4722-8bcc-4137178dfd7a tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:16.659569 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-98927c3c-b32c-4722-8bcc-4137178dfd7a tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1513 microversion: 2.1 time: 0.198539 Jan 24 22:30:16.660283 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 249/502] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:16 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:16.710650 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-cb790296-4d11-4239-a387-ba55fe67be6a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:16.711237 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-cb790296-4d11-4239-a387-ba55fe67be6a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:16.717333 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cb790296-4d11-4239-a387-ba55fe67be6a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:16.717847 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cb790296-4d11-4239-a387-ba55fe67be6a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:16.718623 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cb790296-4d11-4239-a387-ba55fe67be6a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:16.719048 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cb790296-4d11-4239-a387-ba55fe67be6a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:16.748807 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-24b2858b-6f8b-4a96-b4da-b44336fdc4d7 req-c892d92c-27ea-4c9c-a55b-f2d663b34fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96169450-a083-4ea2-bf32-f61642531005", "name": "network-vif-plugged", "status": "completed", "tag": "552da456-962b-427d-9564-afd0551bb574"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:16.750523 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:30:16.750523 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:30:16.758634 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-24b2858b-6f8b-4a96-b4da-b44336fdc4d7 req-c892d92c-27ea-4c9c-a55b-f2d663b34fcb service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:16.759155 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-24b2858b-6f8b-4a96-b4da-b44336fdc4d7 req-c892d92c-27ea-4c9c-a55b-f2d663b34fcb service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:16.772215 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-24b2858b-6f8b-4a96-b4da-b44336fdc4d7 req-c892d92c-27ea-4c9c-a55b-f2d663b34fcb service nova] Creating event network-vif-plugged:552da456-962b-427d-9564-afd0551bb574 for instance 96169450-a083-4ea2-bf32-f61642531005 on hv-cinder-81322 Jan 24 22:30:16.777464 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-24b2858b-6f8b-4a96-b4da-b44336fdc4d7 req-c892d92c-27ea-4c9c-a55b-f2d663b34fcb service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032179 Jan 24 22:30:16.778075 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 250/503] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:30:16.853865 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-cb790296-4d11-4239-a387-ba55fe67be6a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:16.862367 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-cb790296-4d11-4239-a387-ba55fe67be6a tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 200 len: 1502 microversion: 2.1 time: 0.156395 Jan 24 22:30:16.862959 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 254/504] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:16 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:16.930765 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-38b635ec-f67e-4476-8c39-e20450bf7b8a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:16.931559 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-38b635ec-f67e-4476-8c39-e20450bf7b8a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:16.938554 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-38b635ec-f67e-4476-8c39-e20450bf7b8a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:16.939059 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-38b635ec-f67e-4476-8c39-e20450bf7b8a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:16.939849 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-38b635ec-f67e-4476-8c39-e20450bf7b8a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:16.940280 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-38b635ec-f67e-4476-8c39-e20450bf7b8a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:17.082984 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-38b635ec-f67e-4476-8c39-e20450bf7b8a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:17.093214 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-38b635ec-f67e-4476-8c39-e20450bf7b8a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:17.094723 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-38b635ec-f67e-4476-8c39-e20450bf7b8a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:17.096098 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-38b635ec-f67e-4476-8c39-e20450bf7b8a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.169569 Jan 24 22:30:17.096661 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 251/505] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:16 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:17.237626 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4305c3d2-fd3e-4945-94d6-318f4e5c1626 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:17.238248 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4305c3d2-fd3e-4945-94d6-318f4e5c1626 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:17.245365 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4305c3d2-fd3e-4945-94d6-318f4e5c1626 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:17.245816 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4305c3d2-fd3e-4945-94d6-318f4e5c1626 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:17.246576 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4305c3d2-fd3e-4945-94d6-318f4e5c1626 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:17.247036 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4305c3d2-fd3e-4945-94d6-318f4e5c1626 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:17.288097 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-f9bcd9ae-212b-41fb-9480-0d38934eddbe tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:17.288713 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-f9bcd9ae-212b-41fb-9480-0d38934eddbe tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:17.298737 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f9bcd9ae-212b-41fb-9480-0d38934eddbe tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:17.299247 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f9bcd9ae-212b-41fb-9480-0d38934eddbe tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:17.300059 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f9bcd9ae-212b-41fb-9480-0d38934eddbe tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:17.300496 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f9bcd9ae-212b-41fb-9480-0d38934eddbe tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:17.449242 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4305c3d2-fd3e-4945-94d6-318f4e5c1626 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:17.458422 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4305c3d2-fd3e-4945-94d6-318f4e5c1626 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1315 microversion: 2.1 time: 0.226070 Jan 24 22:30:17.459198 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 255/506] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:17 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:17.511383 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-f9bcd9ae-212b-41fb-9480-0d38934eddbe tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:17.522271 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-f9bcd9ae-212b-41fb-9480-0d38934eddbe tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.238724 Jan 24 22:30:17.522864 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 252/507] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:17 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:17.618712 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e0f48b52-dd30-4b05-a9db-84c98a9d9a47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:17.619281 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e0f48b52-dd30-4b05-a9db-84c98a9d9a47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:17.626313 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e0f48b52-dd30-4b05-a9db-84c98a9d9a47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:17.626988 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e0f48b52-dd30-4b05-a9db-84c98a9d9a47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:17.627800 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e0f48b52-dd30-4b05-a9db-84c98a9d9a47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:17.628231 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e0f48b52-dd30-4b05-a9db-84c98a9d9a47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:17.677719 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b8d5f628-f09c-4bf7-bdd3-13d7b705c999 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:17.678757 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b8d5f628-f09c-4bf7-bdd3-13d7b705c999 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:17.684792 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b8d5f628-f09c-4bf7-bdd3-13d7b705c999 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:17.685273 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b8d5f628-f09c-4bf7-bdd3-13d7b705c999 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:17.686094 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b8d5f628-f09c-4bf7-bdd3-13d7b705c999 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:17.686524 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b8d5f628-f09c-4bf7-bdd3-13d7b705c999 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:17.828530 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e0f48b52-dd30-4b05-a9db-84c98a9d9a47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:17.838063 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e0f48b52-dd30-4b05-a9db-84c98a9d9a47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1723 microversion: 2.1 time: 0.223147 Jan 24 22:30:17.849094 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 256/508] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:17 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:17.880053 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9d060ba9-e78a-40bf-a3f0-e578d2159c57 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:17.880425 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b8d5f628-f09c-4bf7-bdd3-13d7b705c999 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:17.882721 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9d060ba9-e78a-40bf-a3f0-e578d2159c57 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:17.891158 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b8d5f628-f09c-4bf7-bdd3-13d7b705c999 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1513 microversion: 2.1 time: 0.219199 Jan 24 22:30:17.891758 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 253/509] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:17 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:17.894218 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9d060ba9-e78a-40bf-a3f0-e578d2159c57 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:17.894682 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9d060ba9-e78a-40bf-a3f0-e578d2159c57 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:17.895473 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9d060ba9-e78a-40bf-a3f0-e578d2159c57 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:17.895900 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9d060ba9-e78a-40bf-a3f0-e578d2159c57 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:18.049173 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-9d060ba9-e78a-40bf-a3f0-e578d2159c57 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:18.058118 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9d060ba9-e78a-40bf-a3f0-e578d2159c57 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 200 len: 1502 microversion: 2.1 time: 0.182024 Jan 24 22:30:18.058899 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 257/510] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:17 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 1502 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:30:18.116579 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c8d764ed-a946-4caf-8e60-003e88d6a818 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:18.117134 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c8d764ed-a946-4caf-8e60-003e88d6a818 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:18.126006 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c8d764ed-a946-4caf-8e60-003e88d6a818 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:18.126747 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c8d764ed-a946-4caf-8e60-003e88d6a818 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:18.127527 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c8d764ed-a946-4caf-8e60-003e88d6a818 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:18.127963 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c8d764ed-a946-4caf-8e60-003e88d6a818 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:18.269803 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c8d764ed-a946-4caf-8e60-003e88d6a818 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:18.280547 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c8d764ed-a946-4caf-8e60-003e88d6a818 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:18.282038 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c8d764ed-a946-4caf-8e60-003e88d6a818 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:18.283420 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c8d764ed-a946-4caf-8e60-003e88d6a818 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.171906 Jan 24 22:30:18.283977 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 254/511] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:18 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:18.481290 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-43940cbb-1606-45f0-aef9-5dbdc62d721a tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:18.482398 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-43940cbb-1606-45f0-aef9-5dbdc62d721a tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:18.491375 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-43940cbb-1606-45f0-aef9-5dbdc62d721a tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:18.491818 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-43940cbb-1606-45f0-aef9-5dbdc62d721a tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:18.492610 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-43940cbb-1606-45f0-aef9-5dbdc62d721a tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:18.493073 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-43940cbb-1606-45f0-aef9-5dbdc62d721a tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:18.543148 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-907a7e4b-2a04-4801-b5a4-786913db1682 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:18.543900 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-907a7e4b-2a04-4801-b5a4-786913db1682 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:18.550191 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-907a7e4b-2a04-4801-b5a4-786913db1682 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:18.550634 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-907a7e4b-2a04-4801-b5a4-786913db1682 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:18.551427 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-907a7e4b-2a04-4801-b5a4-786913db1682 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:18.552019 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-907a7e4b-2a04-4801-b5a4-786913db1682 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:18.679045 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-43940cbb-1606-45f0-aef9-5dbdc62d721a tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:18.687409 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-43940cbb-1606-45f0-aef9-5dbdc62d721a tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1315 microversion: 2.1 time: 0.212767 Jan 24 22:30:18.688755 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 258/512] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:18 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:18.734007 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-907a7e4b-2a04-4801-b5a4-786913db1682 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:18.741704 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-907a7e4b-2a04-4801-b5a4-786913db1682 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.202178 Jan 24 22:30:18.742348 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 255/513] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:18 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:18.857797 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ec8337bb-6641-4e8a-9202-acdbf41a6258 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:18.858693 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ec8337bb-6641-4e8a-9202-acdbf41a6258 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:18.865016 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ec8337bb-6641-4e8a-9202-acdbf41a6258 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:18.865543 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ec8337bb-6641-4e8a-9202-acdbf41a6258 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:18.866288 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ec8337bb-6641-4e8a-9202-acdbf41a6258 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:18.866710 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ec8337bb-6641-4e8a-9202-acdbf41a6258 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:18.908772 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-cf6c8324-c0be-4292-8386-b60efca93558 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:18.909933 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-cf6c8324-c0be-4292-8386-b60efca93558 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:18.916431 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cf6c8324-c0be-4292-8386-b60efca93558 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:18.916887 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cf6c8324-c0be-4292-8386-b60efca93558 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:18.920010 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cf6c8324-c0be-4292-8386-b60efca93558 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:18.920460 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cf6c8324-c0be-4292-8386-b60efca93558 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:18.997228 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-cf6c8324-c0be-4292-8386-b60efca93558 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:19.007652 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-cf6c8324-c0be-4292-8386-b60efca93558 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1471 microversion: 2.1 time: 0.103575 Jan 24 22:30:19.015136 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 256/514] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:18 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1471 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:19.034806 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ec8337bb-6641-4e8a-9202-acdbf41a6258 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:19.040730 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-54a99cb6-df04-47ee-bdff-72194ccbaed9 req-90ad90e0-cd16-482b-83c2-fc4dba9985db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a6892a-6bcf-48a9-ba54-e2f6fce165c8", "name": "network-vif-deleted", "tag": "d633875b-72bb-44b2-823b-29984eecca9f"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:19.042645 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:30:19.042645 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:30:19.042845 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ec8337bb-6641-4e8a-9202-acdbf41a6258 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1723 microversion: 2.1 time: 0.189419 Jan 24 22:30:19.043303 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 259/515] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:18 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:19.051257 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-54a99cb6-df04-47ee-bdff-72194ccbaed9 req-90ad90e0-cd16-482b-83c2-fc4dba9985db service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:19.051917 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-54a99cb6-df04-47ee-bdff-72194ccbaed9 req-90ad90e0-cd16-482b-83c2-fc4dba9985db service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:19.064410 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-54a99cb6-df04-47ee-bdff-72194ccbaed9 req-90ad90e0-cd16-482b-83c2-fc4dba9985db service nova] Creating event network-vif-deleted:d633875b-72bb-44b2-823b-29984eecca9f for instance 60a6892a-6bcf-48a9-ba54-e2f6fce165c8 on hv-cinder-81322 Jan 24 22:30:19.072656 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-54a99cb6-df04-47ee-bdff-72194ccbaed9 req-90ad90e0-cd16-482b-83c2-fc4dba9985db service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036102 Jan 24 22:30:19.079731 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 257/516] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:30:19.080104 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f5544bc8-d11c-43b8-ba14-a2439ca08d32 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:19.080909 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-f5544bc8-d11c-43b8-ba14-a2439ca08d32 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:19.087119 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f5544bc8-d11c-43b8-ba14-a2439ca08d32 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:19.087567 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f5544bc8-d11c-43b8-ba14-a2439ca08d32 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:19.088344 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f5544bc8-d11c-43b8-ba14-a2439ca08d32 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:19.088775 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f5544bc8-d11c-43b8-ba14-a2439ca08d32 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:19.230753 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-f5544bc8-d11c-43b8-ba14-a2439ca08d32 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:19.238524 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-f5544bc8-d11c-43b8-ba14-a2439ca08d32 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 200 len: 1502 microversion: 2.1 time: 0.163636 Jan 24 22:30:19.244296 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 260/517] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:19 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:19.304474 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-5fbc373e-499f-409e-af10-88cb1978b7f5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:19.305298 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-5fbc373e-499f-409e-af10-88cb1978b7f5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:19.312835 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5fbc373e-499f-409e-af10-88cb1978b7f5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:19.313339 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5fbc373e-499f-409e-af10-88cb1978b7f5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:19.314514 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5fbc373e-499f-409e-af10-88cb1978b7f5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:19.316838 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5fbc373e-499f-409e-af10-88cb1978b7f5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:19.484976 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-5fbc373e-499f-409e-af10-88cb1978b7f5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:19.492943 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-5fbc373e-499f-409e-af10-88cb1978b7f5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:19.494514 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-5fbc373e-499f-409e-af10-88cb1978b7f5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:19.495617 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-5fbc373e-499f-409e-af10-88cb1978b7f5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.195683 Jan 24 22:30:19.496173 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 258/518] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:19 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:19.709053 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-7618e378-ccfa-4802-91e3-6c51401322ee tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:19.710085 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-7618e378-ccfa-4802-91e3-6c51401322ee tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:19.720601 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7618e378-ccfa-4802-91e3-6c51401322ee tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:19.721106 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7618e378-ccfa-4802-91e3-6c51401322ee tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:19.721874 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7618e378-ccfa-4802-91e3-6c51401322ee tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:19.722315 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7618e378-ccfa-4802-91e3-6c51401322ee tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:19.758691 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-06ee5b26-7ea6-44c3-b47e-c0af1b004df6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:19.759398 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-06ee5b26-7ea6-44c3-b47e-c0af1b004df6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:19.765815 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-06ee5b26-7ea6-44c3-b47e-c0af1b004df6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:19.766264 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-06ee5b26-7ea6-44c3-b47e-c0af1b004df6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:19.767194 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-06ee5b26-7ea6-44c3-b47e-c0af1b004df6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:19.767651 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-06ee5b26-7ea6-44c3-b47e-c0af1b004df6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:19.887783 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7618e378-ccfa-4802-91e3-6c51401322ee tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:19.896689 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-7618e378-ccfa-4802-91e3-6c51401322ee tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1465 microversion: 2.1 time: 0.193933 Jan 24 22:30:19.901079 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 261/519] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:19 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1465 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:19.934305 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-abd36812-034f-4262-9c49-dba51d99de9c tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:19.935103 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-abd36812-034f-4262-9c49-dba51d99de9c tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:19.943018 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-abd36812-034f-4262-9c49-dba51d99de9c tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:19.943550 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-abd36812-034f-4262-9c49-dba51d99de9c tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:19.944531 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-abd36812-034f-4262-9c49-dba51d99de9c tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:19.945167 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-abd36812-034f-4262-9c49-dba51d99de9c tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:19.950349 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-06ee5b26-7ea6-44c3-b47e-c0af1b004df6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:19.958175 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-06ee5b26-7ea6-44c3-b47e-c0af1b004df6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1502 microversion: 2.1 time: 0.203138 Jan 24 22:30:19.958751 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 259/520] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:19 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:19.973223 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-abd36812-034f-4262-9c49-dba51d99de9c tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Going to try to terminate instance {{(pid=116467) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:30:19.978180 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-03888c62-f23b-4e03-80db-cdb9da9d2666 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8934c9f8-a5d5-49fb-892a-234bad275b36"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:19.979687 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-03888c62-f23b-4e03-80db-cdb9da9d2666 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:19.986777 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-03888c62-f23b-4e03-80db-cdb9da9d2666 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:19.988739 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-03888c62-f23b-4e03-80db-cdb9da9d2666 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:19.989913 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-03888c62-f23b-4e03-80db-cdb9da9d2666 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:19.990152 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-03888c62-f23b-4e03-80db-cdb9da9d2666 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.014711 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-03888c62-f23b-4e03-80db-cdb9da9d2666 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] HTTP exception thrown: Cannot 'attach_volume' instance a871432f-36c3-495a-8269-9de0a0e45315 while it is in vm_state rescued Jan 24 22:30:20.015305 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-03888c62-f23b-4e03-80db-cdb9da9d2666 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Returning 409 to user: Cannot 'attach_volume' instance a871432f-36c3-495a-8269-9de0a0e45315 while it is in vm_state rescued {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:30:20.016146 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-03888c62-f23b-4e03-80db-cdb9da9d2666 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "POST /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045611 Jan 24 22:30:20.017517 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 260/521] 10.222.0.84 () {60 vars in 1322 bytes} [Mon Jan 24 22:30:19 2022] POST /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 24 22:30:20.025508 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-817f5cd5-6885-43a4-97f2-e831940ec8a2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:20.026128 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-817f5cd5-6885-43a4-97f2-e831940ec8a2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:20.033308 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-817f5cd5-6885-43a4-97f2-e831940ec8a2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.033750 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-817f5cd5-6885-43a4-97f2-e831940ec8a2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.035103 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-817f5cd5-6885-43a4-97f2-e831940ec8a2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.035878 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-817f5cd5-6885-43a4-97f2-e831940ec8a2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.067320 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-abd36812-034f-4262-9c49-dba51d99de9c tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "DELETE /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 204 len: 0 microversion: 2.1 time: 0.135734 Jan 24 22:30:20.069186 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 262/522] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:30:19 2022] DELETE /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 24 22:30:20.076201 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-bba486d3-7121-45a4-8ee8-33e79942b0cd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:20.076821 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-bba486d3-7121-45a4-8ee8-33e79942b0cd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:20.084526 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-817f5cd5-6885-43a4-97f2-e831940ec8a2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.085231 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-817f5cd5-6885-43a4-97f2-e831940ec8a2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.085839 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.objects.instance [None req-817f5cd5-6885-43a4-97f2-e831940ec8a2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lazy-loading 'fault' on Instance uuid 60a6892a-6bcf-48a9-ba54-e2f6fce165c8 {{(pid=116466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:30:20.090908 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bba486d3-7121-45a4-8ee8-33e79942b0cd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.091354 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bba486d3-7121-45a4-8ee8-33e79942b0cd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.092143 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bba486d3-7121-45a4-8ee8-33e79942b0cd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.092573 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bba486d3-7121-45a4-8ee8-33e79942b0cd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.126822 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-817f5cd5-6885-43a4-97f2-e831940ec8a2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:20.135011 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-817f5cd5-6885-43a4-97f2-e831940ec8a2 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 200 len: 1307 microversion: 2.1 time: 0.112892 Jan 24 22:30:20.145282 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 261/523] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:20 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 1307 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:20.153643 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c34ca125-550d-435f-9f99-3bc6fee00b7f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:20.153643 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c34ca125-550d-435f-9f99-3bc6fee00b7f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:20.159421 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c34ca125-550d-435f-9f99-3bc6fee00b7f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.159948 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c34ca125-550d-435f-9f99-3bc6fee00b7f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.160804 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c34ca125-550d-435f-9f99-3bc6fee00b7f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.162944 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c34ca125-550d-435f-9f99-3bc6fee00b7f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.193316 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-bba486d3-7121-45a4-8ee8-33e79942b0cd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "POST /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/action" status: 202 len: 0 microversion: 2.1 time: 0.121571 Jan 24 22:30:20.197653 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 263/524] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:30:20 2022] POST /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:30:20.206353 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-17a97815-bb0e-4051-afb1-cef8c50c2041 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:20.207916 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-17a97815-bb0e-4051-afb1-cef8c50c2041 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:20.213892 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-17a97815-bb0e-4051-afb1-cef8c50c2041 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.214519 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-17a97815-bb0e-4051-afb1-cef8c50c2041 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.215407 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-17a97815-bb0e-4051-afb1-cef8c50c2041 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.216083 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-17a97815-bb0e-4051-afb1-cef8c50c2041 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.346884 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c34ca125-550d-435f-9f99-3bc6fee00b7f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:20.355475 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c34ca125-550d-435f-9f99-3bc6fee00b7f tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1700 microversion: 2.1 time: 0.208941 Jan 24 22:30:20.365602 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 262/525] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:20 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1700 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:20.365602 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-deec63de-d2e0-409b-875f-c88dcd393167 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:20.365602 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-deec63de-d2e0-409b-875f-c88dcd393167 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:20.373136 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-deec63de-d2e0-409b-875f-c88dcd393167 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.373835 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-deec63de-d2e0-409b-875f-c88dcd393167 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.374628 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-deec63de-d2e0-409b-875f-c88dcd393167 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.375088 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-deec63de-d2e0-409b-875f-c88dcd393167 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.441332 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-17a97815-bb0e-4051-afb1-cef8c50c2041 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:20.451338 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-17a97815-bb0e-4051-afb1-cef8c50c2041 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1471 microversion: 2.1 time: 0.250578 Jan 24 22:30:20.452105 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 264/526] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:20 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1471 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:20.456737 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-d6b783a7-d15b-4b1f-8106-7a2d08eb7ca8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:20.457907 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-d6b783a7-d15b-4b1f-8106-7a2d08eb7ca8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:20.465895 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d6b783a7-d15b-4b1f-8106-7a2d08eb7ca8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.466452 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d6b783a7-d15b-4b1f-8106-7a2d08eb7ca8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.467296 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d6b783a7-d15b-4b1f-8106-7a2d08eb7ca8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.467788 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d6b783a7-d15b-4b1f-8106-7a2d08eb7ca8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.508285 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d6b783a7-d15b-4b1f-8106-7a2d08eb7ca8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.508818 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d6b783a7-d15b-4b1f-8106-7a2d08eb7ca8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.509390 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-d6b783a7-d15b-4b1f-8106-7a2d08eb7ca8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lazy-loading 'fault' on Instance uuid a3ff8015-35d9-4196-8b1b-ea299e359e25 {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:30:20.569352 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-d6b783a7-d15b-4b1f-8106-7a2d08eb7ca8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '763ba0faf8324e039936fc2086ee6d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745f8e89f0b47f7a49e565becce2c16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:20.577103 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-d6b783a7-d15b-4b1f-8106-7a2d08eb7ca8 tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 200 len: 1303 microversion: 2.1 time: 0.124130 Jan 24 22:30:20.577678 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 265/527] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:20 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 1303 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:20.577798 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-deec63de-d2e0-409b-875f-c88dcd393167 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:20.582777 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3c8c6a4c-c745-443b-8398-9eb1daf4b55b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:20.589518 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3c8c6a4c-c745-443b-8398-9eb1daf4b55b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.589953 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3c8c6a4c-c745-443b-8398-9eb1daf4b55b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.592194 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-deec63de-d2e0-409b-875f-c88dcd393167 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1510 microversion: 2.1 time: 0.235113 Jan 24 22:30:20.602029 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 263/528] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:20 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1510 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:20.602029 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7689a03c-63dc-4f82-8f5b-49e3860ec61a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:20.602029 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7689a03c-63dc-4f82-8f5b-49e3860ec61a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:20.604424 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7689a03c-63dc-4f82-8f5b-49e3860ec61a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.604846 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7689a03c-63dc-4f82-8f5b-49e3860ec61a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.605799 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7689a03c-63dc-4f82-8f5b-49e3860ec61a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.606236 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7689a03c-63dc-4f82-8f5b-49e3860ec61a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.650545 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-3c8c6a4c-c745-443b-8398-9eb1daf4b55b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Going to try to start instance {{(pid=116467) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 24 22:30:20.702670 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-3c8c6a4c-c745-443b-8398-9eb1daf4b55b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 202 len: 0 microversion: 2.1 time: 0.123789 Jan 24 22:30:20.703641 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 266/529] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:30:20 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:30:20.712359 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c647c9bb-2dd3-4ae2-9ab1-39277ae9e0d2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:20.714629 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c647c9bb-2dd3-4ae2-9ab1-39277ae9e0d2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:20.725275 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c647c9bb-2dd3-4ae2-9ab1-39277ae9e0d2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.725908 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c647c9bb-2dd3-4ae2-9ab1-39277ae9e0d2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.727355 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c647c9bb-2dd3-4ae2-9ab1-39277ae9e0d2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:20.727355 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c647c9bb-2dd3-4ae2-9ab1-39277ae9e0d2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:20.762327 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7689a03c-63dc-4f82-8f5b-49e3860ec61a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:20.771283 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7689a03c-63dc-4f82-8f5b-49e3860ec61a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:20.772706 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7689a03c-63dc-4f82-8f5b-49e3860ec61a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:20.773899 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7689a03c-63dc-4f82-8f5b-49e3860ec61a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.180106 Jan 24 22:30:20.784915 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 264/530] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:20 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:20.888595 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-c647c9bb-2dd3-4ae2-9ab1-39277ae9e0d2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:20.897157 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c647c9bb-2dd3-4ae2-9ab1-39277ae9e0d2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1709 microversion: 2.1 time: 0.188910 Jan 24 22:30:20.897725 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 267/531] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:20 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1709 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:21.096290 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-12348b62-e463-4063-8091-472d79ada9a0 req-9ad1f0f1-85d4-4a36-8b6d-8589ba0fcac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ff8015-35d9-4196-8b1b-ea299e359e25", "name": "network-vif-deleted", "tag": "8b459125-0bc6-4985-a7e9-81d9d90957c3"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:21.098147 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:30:21.098147 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:30:21.107656 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-12348b62-e463-4063-8091-472d79ada9a0 req-9ad1f0f1-85d4-4a36-8b6d-8589ba0fcac6 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:21.108262 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-12348b62-e463-4063-8091-472d79ada9a0 req-9ad1f0f1-85d4-4a36-8b6d-8589ba0fcac6 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:21.124511 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-12348b62-e463-4063-8091-472d79ada9a0 req-9ad1f0f1-85d4-4a36-8b6d-8589ba0fcac6 service nova] Creating event network-vif-deleted:8b459125-0bc6-4985-a7e9-81d9d90957c3 for instance a3ff8015-35d9-4196-8b1b-ea299e359e25 on hv-cinder-81322 Jan 24 22:30:21.130620 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-12348b62-e463-4063-8091-472d79ada9a0 req-9ad1f0f1-85d4-4a36-8b6d-8589ba0fcac6 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039519 Jan 24 22:30:21.131214 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 265/532] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:30:21.152513 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-34cec8a2-4a80-40bc-b629-441e14e0e85b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:21.153334 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-34cec8a2-4a80-40bc-b629-441e14e0e85b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 60a6892a-6bcf-48a9-ba54-e2f6fce165c8] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:21.161250 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-34cec8a2-4a80-40bc-b629-441e14e0e85b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:21.161799 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-34cec8a2-4a80-40bc-b629-441e14e0e85b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:21.163256 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-34cec8a2-4a80-40bc-b629-441e14e0e85b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:21.163795 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-34cec8a2-4a80-40bc-b629-441e14e0e85b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:21.180333 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-34cec8a2-4a80-40bc-b629-441e14e0e85b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] HTTP exception thrown: Instance 60a6892a-6bcf-48a9-ba54-e2f6fce165c8 could not be found. Jan 24 22:30:21.183277 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-34cec8a2-4a80-40bc-b629-441e14e0e85b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Returning 404 to user: Instance 60a6892a-6bcf-48a9-ba54-e2f6fce165c8 could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:30:21.184228 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-34cec8a2-4a80-40bc-b629-441e14e0e85b tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8" status: 404 len: 111 microversion: 2.1 time: 0.036477 Jan 24 22:30:21.187973 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 268/533] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:21 2022] GET /compute/v2.1/servers/60a6892a-6bcf-48a9-ba54-e2f6fce165c8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:30:21.474289 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a3d243b9-c1b2-43fd-85fb-9fb18c940b60 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:21.475412 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a3d243b9-c1b2-43fd-85fb-9fb18c940b60 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:21.481651 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a3d243b9-c1b2-43fd-85fb-9fb18c940b60 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:21.482098 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a3d243b9-c1b2-43fd-85fb-9fb18c940b60 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:21.482872 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a3d243b9-c1b2-43fd-85fb-9fb18c940b60 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:21.483464 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a3d243b9-c1b2-43fd-85fb-9fb18c940b60 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:21.605138 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-689471cd-984c-4676-9249-5f233fdf7d9d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:21.608368 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-689471cd-984c-4676-9249-5f233fdf7d9d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] [instance: a3ff8015-35d9-4196-8b1b-ea299e359e25] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:21.618316 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-689471cd-984c-4676-9249-5f233fdf7d9d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:21.619367 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-689471cd-984c-4676-9249-5f233fdf7d9d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:21.620684 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-689471cd-984c-4676-9249-5f233fdf7d9d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:21.621467 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-689471cd-984c-4676-9249-5f233fdf7d9d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:21.636248 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a3d243b9-c1b2-43fd-85fb-9fb18c940b60 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:21.643982 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-689471cd-984c-4676-9249-5f233fdf7d9d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] HTTP exception thrown: Instance a3ff8015-35d9-4196-8b1b-ea299e359e25 could not be found. Jan 24 22:30:21.644937 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-689471cd-984c-4676-9249-5f233fdf7d9d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] Returning 404 to user: Instance a3ff8015-35d9-4196-8b1b-ea299e359e25 could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:30:21.646011 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-689471cd-984c-4676-9249-5f233fdf7d9d tempest-VolumesActionsTest-967987323 tempest-VolumesActionsTest-967987323-project] 10.222.0.84 "GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25" status: 404 len: 111 microversion: 2.1 time: 0.055781 Jan 24 22:30:21.646917 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 269/534] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:21 2022] GET /compute/v2.1/servers/a3ff8015-35d9-4196-8b1b-ea299e359e25 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:30:21.657540 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ed3ff787-246f-405a-848f-51bcefc50745 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:21.658287 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ed3ff787-246f-405a-848f-51bcefc50745 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:21.666720 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ed3ff787-246f-405a-848f-51bcefc50745 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:21.667551 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ed3ff787-246f-405a-848f-51bcefc50745 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:21.667842 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ed3ff787-246f-405a-848f-51bcefc50745 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:21.668439 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ed3ff787-246f-405a-848f-51bcefc50745 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:21.674940 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a3d243b9-c1b2-43fd-85fb-9fb18c940b60 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1471 microversion: 2.1 time: 0.205431 Jan 24 22:30:21.679400 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 266/535] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:21 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1471 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:21.798659 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b7b23124-f465-4810-9ff0-88319a5a6177 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:21.799792 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b7b23124-f465-4810-9ff0-88319a5a6177 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:21.813103 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b7b23124-f465-4810-9ff0-88319a5a6177 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:21.813671 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b7b23124-f465-4810-9ff0-88319a5a6177 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:21.814639 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b7b23124-f465-4810-9ff0-88319a5a6177 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:21.815057 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b7b23124-f465-4810-9ff0-88319a5a6177 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:21.830649 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ed3ff787-246f-405a-848f-51bcefc50745 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:21.841380 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ed3ff787-246f-405a-848f-51bcefc50745 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1510 microversion: 2.1 time: 0.187688 Jan 24 22:30:21.842263 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 270/536] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:21 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1510 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:21.915446 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-bf3e5a76-6b6f-4501-9be9-8ea4473d8e78 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:21.916161 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-bf3e5a76-6b6f-4501-9be9-8ea4473d8e78 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:21.924280 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bf3e5a76-6b6f-4501-9be9-8ea4473d8e78 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:21.927437 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bf3e5a76-6b6f-4501-9be9-8ea4473d8e78 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:21.928491 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bf3e5a76-6b6f-4501-9be9-8ea4473d8e78 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:21.929051 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bf3e5a76-6b6f-4501-9be9-8ea4473d8e78 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:22.045351 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b7b23124-f465-4810-9ff0-88319a5a6177 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:22.055011 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b7b23124-f465-4810-9ff0-88319a5a6177 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:22.056022 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b7b23124-f465-4810-9ff0-88319a5a6177 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:22.057524 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b7b23124-f465-4810-9ff0-88319a5a6177 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.269001 Jan 24 22:30:22.068936 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 267/537] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:21 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:22.148246 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-bf3e5a76-6b6f-4501-9be9-8ea4473d8e78 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:22.156978 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-bf3e5a76-6b6f-4501-9be9-8ea4473d8e78 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1709 microversion: 2.1 time: 0.245863 Jan 24 22:30:22.157861 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 271/538] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:21 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1709 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:30:22.324114 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6514e421-4a65-4bf2-8840-4e2791075c92 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:22.325453 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6514e421-4a65-4bf2-8840-4e2791075c92 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:22.333676 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6514e421-4a65-4bf2-8840-4e2791075c92 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:22.334069 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6514e421-4a65-4bf2-8840-4e2791075c92 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:22.334853 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6514e421-4a65-4bf2-8840-4e2791075c92 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:22.335285 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6514e421-4a65-4bf2-8840-4e2791075c92 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:22.372528 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6514e421-4a65-4bf2-8840-4e2791075c92 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Going to try to terminate instance {{(pid=116466) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:30:22.469445 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6514e421-4a65-4bf2-8840-4e2791075c92 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "DELETE /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 204 len: 0 microversion: 2.1 time: 0.148766 Jan 24 22:30:22.470244 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 268/539] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:30:22 2022] DELETE /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:30:22.478970 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0f3daade-30a7-4cc8-9ff2-1fcadafbfd2c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:22.479570 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0f3daade-30a7-4cc8-9ff2-1fcadafbfd2c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:22.486603 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0f3daade-30a7-4cc8-9ff2-1fcadafbfd2c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:22.488241 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0f3daade-30a7-4cc8-9ff2-1fcadafbfd2c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:22.489511 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0f3daade-30a7-4cc8-9ff2-1fcadafbfd2c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:22.490079 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0f3daade-30a7-4cc8-9ff2-1fcadafbfd2c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:22.632560 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0f3daade-30a7-4cc8-9ff2-1fcadafbfd2c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:22.640709 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0f3daade-30a7-4cc8-9ff2-1fcadafbfd2c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1513 microversion: 2.1 time: 0.165989 Jan 24 22:30:22.641501 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 272/540] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:22 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:22.695487 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3abfdc0a-4763-4786-bc32-562c8d835fc4 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:22.696178 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3abfdc0a-4763-4786-bc32-562c8d835fc4 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:22.702340 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3abfdc0a-4763-4786-bc32-562c8d835fc4 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:22.702783 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3abfdc0a-4763-4786-bc32-562c8d835fc4 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:22.703545 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3abfdc0a-4763-4786-bc32-562c8d835fc4 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:22.703971 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3abfdc0a-4763-4786-bc32-562c8d835fc4 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:22.842085 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3abfdc0a-4763-4786-bc32-562c8d835fc4 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:22.851721 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3abfdc0a-4763-4786-bc32-562c8d835fc4 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1471 microversion: 2.1 time: 0.160263 Jan 24 22:30:22.852602 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 269/541] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:22 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:22.859397 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c71676a3-3e27-4a42-b3fc-e6bd83ac67fd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:22.860005 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c71676a3-3e27-4a42-b3fc-e6bd83ac67fd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:22.870409 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c71676a3-3e27-4a42-b3fc-e6bd83ac67fd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:22.871091 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c71676a3-3e27-4a42-b3fc-e6bd83ac67fd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:22.871877 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c71676a3-3e27-4a42-b3fc-e6bd83ac67fd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:22.872311 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c71676a3-3e27-4a42-b3fc-e6bd83ac67fd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:23.007155 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-c71676a3-3e27-4a42-b3fc-e6bd83ac67fd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:23.015550 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c71676a3-3e27-4a42-b3fc-e6bd83ac67fd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1510 microversion: 2.1 time: 0.159559 Jan 24 22:30:23.015840 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 273/542] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:22 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:23.075823 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-db44b728-e34d-4ecb-aa37-30c82afcaa86 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:23.076425 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-db44b728-e34d-4ecb-aa37-30c82afcaa86 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:23.083226 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-db44b728-e34d-4ecb-aa37-30c82afcaa86 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:23.083683 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-db44b728-e34d-4ecb-aa37-30c82afcaa86 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:23.084460 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-db44b728-e34d-4ecb-aa37-30c82afcaa86 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:23.084891 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-db44b728-e34d-4ecb-aa37-30c82afcaa86 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:23.174542 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-10a2fd88-649c-4dd0-a150-d8b04cedde4a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:23.175212 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-10a2fd88-649c-4dd0-a150-d8b04cedde4a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:23.181822 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-10a2fd88-649c-4dd0-a150-d8b04cedde4a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:23.182272 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-10a2fd88-649c-4dd0-a150-d8b04cedde4a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:23.183058 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-10a2fd88-649c-4dd0-a150-d8b04cedde4a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:23.183458 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-10a2fd88-649c-4dd0-a150-d8b04cedde4a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:23.235198 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-db44b728-e34d-4ecb-aa37-30c82afcaa86 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:23.243605 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-db44b728-e34d-4ecb-aa37-30c82afcaa86 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:23.245095 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-db44b728-e34d-4ecb-aa37-30c82afcaa86 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:23.246255 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-db44b728-e34d-4ecb-aa37-30c82afcaa86 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.174303 Jan 24 22:30:23.246854 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 270/543] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:23 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:23.322985 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-10a2fd88-649c-4dd0-a150-d8b04cedde4a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:23.335330 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-10a2fd88-649c-4dd0-a150-d8b04cedde4a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1709 microversion: 2.1 time: 0.164232 Jan 24 22:30:23.336023 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 274/544] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:23 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1709 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:30:23.661512 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-31c3289c-5873-4200-b69f-8fcaa062ce29 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:23.662494 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-31c3289c-5873-4200-b69f-8fcaa062ce29 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:23.673210 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-31c3289c-5873-4200-b69f-8fcaa062ce29 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:23.673654 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-31c3289c-5873-4200-b69f-8fcaa062ce29 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:23.674424 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-31c3289c-5873-4200-b69f-8fcaa062ce29 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:23.674849 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-31c3289c-5873-4200-b69f-8fcaa062ce29 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:23.821944 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-31c3289c-5873-4200-b69f-8fcaa062ce29 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:23.829805 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-31c3289c-5873-4200-b69f-8fcaa062ce29 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1513 microversion: 2.1 time: 0.174493 Jan 24 22:30:23.830374 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 271/545] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:23 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:23.872360 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9a330e48-a7ab-46d4-9536-db1f0463e7b5 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:23.872928 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9a330e48-a7ab-46d4-9536-db1f0463e7b5 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:23.880324 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9a330e48-a7ab-46d4-9536-db1f0463e7b5 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:23.880767 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9a330e48-a7ab-46d4-9536-db1f0463e7b5 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:23.881560 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9a330e48-a7ab-46d4-9536-db1f0463e7b5 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:23.881978 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9a330e48-a7ab-46d4-9536-db1f0463e7b5 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:24.031413 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-9a330e48-a7ab-46d4-9536-db1f0463e7b5 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:24.037008 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-dfa8c915-f5ac-413f-84fd-6a3c47356e4e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:24.037612 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-dfa8c915-f5ac-413f-84fd-6a3c47356e4e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:24.041016 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9a330e48-a7ab-46d4-9536-db1f0463e7b5 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1471 microversion: 2.1 time: 0.174457 Jan 24 22:30:24.041568 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 275/546] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:23 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:24.043555 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-dfa8c915-f5ac-413f-84fd-6a3c47356e4e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:24.043995 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-dfa8c915-f5ac-413f-84fd-6a3c47356e4e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:24.044796 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-dfa8c915-f5ac-413f-84fd-6a3c47356e4e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:24.045281 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-dfa8c915-f5ac-413f-84fd-6a3c47356e4e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:24.180814 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-dfa8c915-f5ac-413f-84fd-6a3c47356e4e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:24.188414 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-dfa8c915-f5ac-413f-84fd-6a3c47356e4e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1510 microversion: 2.1 time: 0.155044 Jan 24 22:30:24.189022 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 272/547] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:24 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:24.271085 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4e6bdcec-f869-4d77-a421-8b978aaff5a5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:24.271682 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4e6bdcec-f869-4d77-a421-8b978aaff5a5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:24.281566 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4e6bdcec-f869-4d77-a421-8b978aaff5a5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:24.281980 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4e6bdcec-f869-4d77-a421-8b978aaff5a5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:24.283052 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4e6bdcec-f869-4d77-a421-8b978aaff5a5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:24.283515 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4e6bdcec-f869-4d77-a421-8b978aaff5a5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:24.357184 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-0c674f5f-17a0-4db4-9f0a-215548869170 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:24.358245 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-0c674f5f-17a0-4db4-9f0a-215548869170 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:24.364479 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0c674f5f-17a0-4db4-9f0a-215548869170 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:24.364964 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0c674f5f-17a0-4db4-9f0a-215548869170 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:24.365788 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0c674f5f-17a0-4db4-9f0a-215548869170 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:24.366219 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0c674f5f-17a0-4db4-9f0a-215548869170 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:24.446915 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4e6bdcec-f869-4d77-a421-8b978aaff5a5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:24.455502 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4e6bdcec-f869-4d77-a421-8b978aaff5a5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:24.456954 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4e6bdcec-f869-4d77-a421-8b978aaff5a5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:24.458125 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4e6bdcec-f869-4d77-a421-8b978aaff5a5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.193574 Jan 24 22:30:24.458776 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 276/548] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:24 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:24.517993 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-0c674f5f-17a0-4db4-9f0a-215548869170 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:24.526424 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-0c674f5f-17a0-4db4-9f0a-215548869170 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1709 microversion: 2.1 time: 0.174302 Jan 24 22:30:24.527005 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 273/549] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:24 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1709 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:24.848735 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-15c86bfd-2b39-4433-a7c7-6f7dcd4d5598 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:24.849285 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-15c86bfd-2b39-4433-a7c7-6f7dcd4d5598 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:24.855797 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-15c86bfd-2b39-4433-a7c7-6f7dcd4d5598 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:24.856252 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-15c86bfd-2b39-4433-a7c7-6f7dcd4d5598 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:24.857012 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-15c86bfd-2b39-4433-a7c7-6f7dcd4d5598 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:24.857479 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-15c86bfd-2b39-4433-a7c7-6f7dcd4d5598 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:25.000567 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-15c86bfd-2b39-4433-a7c7-6f7dcd4d5598 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:25.013211 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-15c86bfd-2b39-4433-a7c7-6f7dcd4d5598 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1513 microversion: 2.1 time: 0.168689 Jan 24 22:30:25.014138 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 277/550] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:24 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:25.060586 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8f6e1ebe-4177-43bb-a9a5-e1dd495978a2 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:25.061223 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8f6e1ebe-4177-43bb-a9a5-e1dd495978a2 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:25.071034 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8f6e1ebe-4177-43bb-a9a5-e1dd495978a2 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:25.071623 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8f6e1ebe-4177-43bb-a9a5-e1dd495978a2 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:25.072829 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8f6e1ebe-4177-43bb-a9a5-e1dd495978a2 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:25.073426 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8f6e1ebe-4177-43bb-a9a5-e1dd495978a2 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:25.205901 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-bdc0195f-7bb3-4a51-8888-2b5f7eb28b92 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:25.206506 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-bdc0195f-7bb3-4a51-8888-2b5f7eb28b92 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:25.212798 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bdc0195f-7bb3-4a51-8888-2b5f7eb28b92 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:25.213342 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bdc0195f-7bb3-4a51-8888-2b5f7eb28b92 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:25.214222 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bdc0195f-7bb3-4a51-8888-2b5f7eb28b92 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:25.214505 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-8f6e1ebe-4177-43bb-a9a5-e1dd495978a2 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:25.214793 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bdc0195f-7bb3-4a51-8888-2b5f7eb28b92 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:25.222323 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8f6e1ebe-4177-43bb-a9a5-e1dd495978a2 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1471 microversion: 2.1 time: 0.167518 Jan 24 22:30:25.222925 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 274/551] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:25 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:25.353632 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-bdc0195f-7bb3-4a51-8888-2b5f7eb28b92 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:25.361140 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-bdc0195f-7bb3-4a51-8888-2b5f7eb28b92 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1510 microversion: 2.1 time: 0.159084 Jan 24 22:30:25.361702 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 278/552] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:25 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:25.476210 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3bbe110d-eba9-4371-aeba-5d760283cd3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:25.476835 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3bbe110d-eba9-4371-aeba-5d760283cd3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:25.483355 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3bbe110d-eba9-4371-aeba-5d760283cd3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:25.483811 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3bbe110d-eba9-4371-aeba-5d760283cd3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:25.484588 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3bbe110d-eba9-4371-aeba-5d760283cd3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:25.485025 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3bbe110d-eba9-4371-aeba-5d760283cd3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:25.543980 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-73e89736-13c5-4f19-99f6-aa071d0a7fdb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:25.544578 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-73e89736-13c5-4f19-99f6-aa071d0a7fdb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:25.550766 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-73e89736-13c5-4f19-99f6-aa071d0a7fdb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:25.551289 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-73e89736-13c5-4f19-99f6-aa071d0a7fdb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:25.551983 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-73e89736-13c5-4f19-99f6-aa071d0a7fdb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:25.552642 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-73e89736-13c5-4f19-99f6-aa071d0a7fdb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:25.651690 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3bbe110d-eba9-4371-aeba-5d760283cd3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:25.661025 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3bbe110d-eba9-4371-aeba-5d760283cd3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:25.662398 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3bbe110d-eba9-4371-aeba-5d760283cd3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:25.663569 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3bbe110d-eba9-4371-aeba-5d760283cd3c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.191234 Jan 24 22:30:25.664122 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 275/553] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:25 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:25.720743 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-73e89736-13c5-4f19-99f6-aa071d0a7fdb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:25.728580 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-73e89736-13c5-4f19-99f6-aa071d0a7fdb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1709 microversion: 2.1 time: 0.188303 Jan 24 22:30:25.729169 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 279/554] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:25 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1709 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:25.982354 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-d834d5c9-79da-43df-a4a8-8285ae1636c4 req-7b4fee49-300b-4338-a671-d7b18357f4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96169450-a083-4ea2-bf32-f61642531005", "name": "network-vif-deleted", "tag": "552da456-962b-427d-9564-afd0551bb574"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:25.983909 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:30:25.983909 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:30:25.992736 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-d834d5c9-79da-43df-a4a8-8285ae1636c4 req-7b4fee49-300b-4338-a671-d7b18357f4a6 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:25.993185 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-d834d5c9-79da-43df-a4a8-8285ae1636c4 req-7b4fee49-300b-4338-a671-d7b18357f4a6 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:26.005172 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-d834d5c9-79da-43df-a4a8-8285ae1636c4 req-7b4fee49-300b-4338-a671-d7b18357f4a6 service nova] Creating event network-vif-deleted:552da456-962b-427d-9564-afd0551bb574 for instance 96169450-a083-4ea2-bf32-f61642531005 on hv-cinder-81322 Jan 24 22:30:26.010140 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-d834d5c9-79da-43df-a4a8-8285ae1636c4 req-7b4fee49-300b-4338-a671-d7b18357f4a6 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031612 Jan 24 22:30:26.010916 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 276/555] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:30:26.031103 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6e2069d2-d07f-423b-b14b-515d5e78ccec tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:26.031865 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6e2069d2-d07f-423b-b14b-515d5e78ccec tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:26.038840 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6e2069d2-d07f-423b-b14b-515d5e78ccec tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:26.039325 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6e2069d2-d07f-423b-b14b-515d5e78ccec tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:26.040104 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6e2069d2-d07f-423b-b14b-515d5e78ccec tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:26.040518 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6e2069d2-d07f-423b-b14b-515d5e78ccec tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:26.180018 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6e2069d2-d07f-423b-b14b-515d5e78ccec tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:26.187386 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6e2069d2-d07f-423b-b14b-515d5e78ccec tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1513 microversion: 2.1 time: 0.160197 Jan 24 22:30:26.187950 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 280/556] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:26 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:26.240555 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-d8c0ba14-484f-469f-80b9-839ddb07b293 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:26.241218 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d8c0ba14-484f-469f-80b9-839ddb07b293 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:26.247697 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d8c0ba14-484f-469f-80b9-839ddb07b293 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:26.248142 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d8c0ba14-484f-469f-80b9-839ddb07b293 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:26.248907 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d8c0ba14-484f-469f-80b9-839ddb07b293 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:26.249435 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d8c0ba14-484f-469f-80b9-839ddb07b293 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:26.280015 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d8c0ba14-484f-469f-80b9-839ddb07b293 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:26.280457 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d8c0ba14-484f-469f-80b9-839ddb07b293 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:26.280889 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.objects.instance [None req-d8c0ba14-484f-469f-80b9-839ddb07b293 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lazy-loading 'fault' on Instance uuid 96169450-a083-4ea2-bf32-f61642531005 {{(pid=116466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:30:26.322017 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d8c0ba14-484f-469f-80b9-839ddb07b293 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21aecbf99a5548deb5b2a0581a27326b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1b7d2ae02848258a135c41a6fd52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:26.329918 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-d8c0ba14-484f-469f-80b9-839ddb07b293 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 200 len: 1305 microversion: 2.1 time: 0.093910 Jan 24 22:30:26.330434 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 277/557] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:26 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:26.377499 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4958234d-bf2d-4876-9aa0-7873f5be59c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:26.378098 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4958234d-bf2d-4876-9aa0-7873f5be59c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:26.384426 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4958234d-bf2d-4876-9aa0-7873f5be59c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:26.384867 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4958234d-bf2d-4876-9aa0-7873f5be59c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:26.385656 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4958234d-bf2d-4876-9aa0-7873f5be59c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:26.386076 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4958234d-bf2d-4876-9aa0-7873f5be59c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:26.523223 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4958234d-bf2d-4876-9aa0-7873f5be59c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:26.533401 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4958234d-bf2d-4876-9aa0-7873f5be59c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1510 microversion: 2.1 time: 0.159260 Jan 24 22:30:26.534056 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 281/558] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:26 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:26.681392 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-31edc916-238d-4e29-9cde-43f31bf34ac0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:26.681998 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-31edc916-238d-4e29-9cde-43f31bf34ac0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:26.687958 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-31edc916-238d-4e29-9cde-43f31bf34ac0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:26.688430 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-31edc916-238d-4e29-9cde-43f31bf34ac0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:26.689307 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-31edc916-238d-4e29-9cde-43f31bf34ac0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:26.689771 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-31edc916-238d-4e29-9cde-43f31bf34ac0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:26.745653 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9914376b-6629-4a44-90e4-02cd946f00b6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:26.746290 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9914376b-6629-4a44-90e4-02cd946f00b6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:26.752782 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9914376b-6629-4a44-90e4-02cd946f00b6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:26.753228 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9914376b-6629-4a44-90e4-02cd946f00b6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:26.754038 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9914376b-6629-4a44-90e4-02cd946f00b6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:26.754468 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9914376b-6629-4a44-90e4-02cd946f00b6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:26.849212 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-31edc916-238d-4e29-9cde-43f31bf34ac0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:26.857464 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-31edc916-238d-4e29-9cde-43f31bf34ac0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:26.859144 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-31edc916-238d-4e29-9cde-43f31bf34ac0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:26.860636 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-31edc916-238d-4e29-9cde-43f31bf34ac0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.182788 Jan 24 22:30:26.861687 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 278/559] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:26 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:26.913924 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-9914376b-6629-4a44-90e4-02cd946f00b6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:26.922636 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9914376b-6629-4a44-90e4-02cd946f00b6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1713 microversion: 2.1 time: 0.180745 Jan 24 22:30:26.923250 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 282/560] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:26 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1713 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:27.203553 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6125216e-3cf1-42b0-af1d-18fd4e724960 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:27.204380 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6125216e-3cf1-42b0-af1d-18fd4e724960 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:27.210313 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6125216e-3cf1-42b0-af1d-18fd4e724960 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:27.210755 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6125216e-3cf1-42b0-af1d-18fd4e724960 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:27.211522 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6125216e-3cf1-42b0-af1d-18fd4e724960 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:27.211951 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6125216e-3cf1-42b0-af1d-18fd4e724960 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:27.350221 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-6125216e-3cf1-42b0-af1d-18fd4e724960 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:27.352087 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-db71da36-d652-4f5c-8e87-e021e80b4bf1 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:27.352711 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-db71da36-d652-4f5c-8e87-e021e80b4bf1 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] [instance: 96169450-a083-4ea2-bf32-f61642531005] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:27.359753 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6125216e-3cf1-42b0-af1d-18fd4e724960 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1513 microversion: 2.1 time: 0.159822 Jan 24 22:30:27.361055 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 279/561] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:27 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:30:27.362207 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-db71da36-d652-4f5c-8e87-e021e80b4bf1 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:27.362656 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-db71da36-d652-4f5c-8e87-e021e80b4bf1 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:27.363447 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-db71da36-d652-4f5c-8e87-e021e80b4bf1 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:27.364045 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-db71da36-d652-4f5c-8e87-e021e80b4bf1 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:27.379235 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-db71da36-d652-4f5c-8e87-e021e80b4bf1 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] HTTP exception thrown: Instance 96169450-a083-4ea2-bf32-f61642531005 could not be found. Jan 24 22:30:27.380089 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-db71da36-d652-4f5c-8e87-e021e80b4bf1 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] Returning 404 to user: Instance 96169450-a083-4ea2-bf32-f61642531005 could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:30:27.380909 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-db71da36-d652-4f5c-8e87-e021e80b4bf1 tempest-VolumesNegativeTest-1064305607 tempest-VolumesNegativeTest-1064305607-project] 10.222.0.84 "GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005" status: 404 len: 111 microversion: 2.1 time: 0.033022 Jan 24 22:30:27.381491 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 283/562] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:27 2022] GET /compute/v2.1/servers/96169450-a083-4ea2-bf32-f61642531005 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 24 22:30:27.551734 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ea2fc181-6911-4a43-8d06-01aa6088e6d6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:27.552444 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ea2fc181-6911-4a43-8d06-01aa6088e6d6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:27.559483 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ea2fc181-6911-4a43-8d06-01aa6088e6d6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:27.560193 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ea2fc181-6911-4a43-8d06-01aa6088e6d6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:27.561160 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ea2fc181-6911-4a43-8d06-01aa6088e6d6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:27.561930 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ea2fc181-6911-4a43-8d06-01aa6088e6d6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:27.741807 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ea2fc181-6911-4a43-8d06-01aa6088e6d6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:27.752851 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ea2fc181-6911-4a43-8d06-01aa6088e6d6 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1516 microversion: 2.1 time: 0.204633 Jan 24 22:30:27.754329 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 280/563] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:27 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1516 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:27.880649 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-56038193-5e22-40c7-bf46-016a5720580c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:27.881180 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-56038193-5e22-40c7-bf46-016a5720580c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:27.891635 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-56038193-5e22-40c7-bf46-016a5720580c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:27.895090 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-56038193-5e22-40c7-bf46-016a5720580c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:27.895948 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-56038193-5e22-40c7-bf46-016a5720580c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:27.896383 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-56038193-5e22-40c7-bf46-016a5720580c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:28.168551 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-56038193-5e22-40c7-bf46-016a5720580c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:28.183727 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-56038193-5e22-40c7-bf46-016a5720580c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:28.190257 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-56038193-5e22-40c7-bf46-016a5720580c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:28.194665 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-56038193-5e22-40c7-bf46-016a5720580c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.317235 Jan 24 22:30:28.196094 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 284/564] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:27 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:28.375652 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-0e226d43-c37c-424f-a44d-8e82bc46dc9d tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:28.376972 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-0e226d43-c37c-424f-a44d-8e82bc46dc9d tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:28.387340 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0e226d43-c37c-424f-a44d-8e82bc46dc9d tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:28.392699 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0e226d43-c37c-424f-a44d-8e82bc46dc9d tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:28.393793 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0e226d43-c37c-424f-a44d-8e82bc46dc9d tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:28.394441 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0e226d43-c37c-424f-a44d-8e82bc46dc9d tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:28.590542 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-0e226d43-c37c-424f-a44d-8e82bc46dc9d tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:28.600714 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-0e226d43-c37c-424f-a44d-8e82bc46dc9d tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1513 microversion: 2.1 time: 0.228115 Jan 24 22:30:28.601645 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 281/565] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:28 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:28.899596 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-1f8121ec-abb5-4813-9bcd-ffe0f4ad4847 req-6bd6a884-d988-4f77-9f4a-096961106db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a5b58c-493c-46a9-a297-4fd94047866f", "name": "network-vif-deleted", "tag": "344c5aaf-3a45-41e2-9d8d-0acafb3d1e31"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:28.903510 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:30:28.903510 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:30:28.917100 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-1f8121ec-abb5-4813-9bcd-ffe0f4ad4847 req-6bd6a884-d988-4f77-9f4a-096961106db6 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:28.917819 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-1f8121ec-abb5-4813-9bcd-ffe0f4ad4847 req-6bd6a884-d988-4f77-9f4a-096961106db6 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:28.932807 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-1f8121ec-abb5-4813-9bcd-ffe0f4ad4847 req-6bd6a884-d988-4f77-9f4a-096961106db6 service nova] Creating event network-vif-deleted:344c5aaf-3a45-41e2-9d8d-0acafb3d1e31 for instance 14a5b58c-493c-46a9-a297-4fd94047866f on hv-cinder-81322 Jan 24 22:30:28.940393 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-1f8121ec-abb5-4813-9bcd-ffe0f4ad4847 req-6bd6a884-d988-4f77-9f4a-096961106db6 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046294 Jan 24 22:30:28.941561 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 285/566] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:30:29.214031 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-9a09a897-8955-4dd9-bbd9-abeea4a8561e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:29.215396 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-9a09a897-8955-4dd9-bbd9-abeea4a8561e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:29.226401 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9a09a897-8955-4dd9-bbd9-abeea4a8561e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:29.227085 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9a09a897-8955-4dd9-bbd9-abeea4a8561e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:29.229509 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9a09a897-8955-4dd9-bbd9-abeea4a8561e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:29.230180 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9a09a897-8955-4dd9-bbd9-abeea4a8561e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:29.291083 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-bbea96fe-6585-49cd-b6f1-02d198ef4114 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:29.291858 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-bbea96fe-6585-49cd-b6f1-02d198ef4114 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:29.300756 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bbea96fe-6585-49cd-b6f1-02d198ef4114 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:29.301597 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bbea96fe-6585-49cd-b6f1-02d198ef4114 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:29.302794 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bbea96fe-6585-49cd-b6f1-02d198ef4114 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:29.303229 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bbea96fe-6585-49cd-b6f1-02d198ef4114 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:29.426177 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-9a09a897-8955-4dd9-bbd9-abeea4a8561e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:29.450932 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-9a09a897-8955-4dd9-bbd9-abeea4a8561e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:29.453333 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-9a09a897-8955-4dd9-bbd9-abeea4a8561e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:29.455724 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-9a09a897-8955-4dd9-bbd9-abeea4a8561e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.245326 Jan 24 22:30:29.470442 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 282/567] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:29 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:29.523650 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-bbea96fe-6585-49cd-b6f1-02d198ef4114 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:29.531927 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-bbea96fe-6585-49cd-b6f1-02d198ef4114 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1516 microversion: 2.1 time: 0.244955 Jan 24 22:30:29.532781 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 286/568] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:29 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1516 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:30:29.555450 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6562b303-1a8b-403b-a1e2-92aa5951b242 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d40d2103-9569-4741-b5d6-1bcce25a906d"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:29.556909 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6562b303-1a8b-403b-a1e2-92aa5951b242 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:29.564284 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6562b303-1a8b-403b-a1e2-92aa5951b242 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:29.564723 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6562b303-1a8b-403b-a1e2-92aa5951b242 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:29.565569 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6562b303-1a8b-403b-a1e2-92aa5951b242 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:29.565936 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6562b303-1a8b-403b-a1e2-92aa5951b242 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:29.618440 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b21c1cc9-51d4-4566-aab0-50baebd9d261 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:29.621338 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b21c1cc9-51d4-4566-aab0-50baebd9d261 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:29.637398 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b21c1cc9-51d4-4566-aab0-50baebd9d261 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:29.638685 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b21c1cc9-51d4-4566-aab0-50baebd9d261 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:29.639483 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b21c1cc9-51d4-4566-aab0-50baebd9d261 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:29.640087 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b21c1cc9-51d4-4566-aab0-50baebd9d261 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:29.701418 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b21c1cc9-51d4-4566-aab0-50baebd9d261 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:29.701857 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b21c1cc9-51d4-4566-aab0-50baebd9d261 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:29.702329 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-b21c1cc9-51d4-4566-aab0-50baebd9d261 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lazy-loading 'fault' on Instance uuid 14a5b58c-493c-46a9-a297-4fd94047866f {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:30:29.774339 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b21c1cc9-51d4-4566-aab0-50baebd9d261 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:29.783203 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b21c1cc9-51d4-4566-aab0-50baebd9d261 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 200 len: 1307 microversion: 2.1 time: 0.168960 Jan 24 22:30:29.784015 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 287/569] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:29 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 1307 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:30.024239 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6562b303-1a8b-403b-a1e2-92aa5951b242 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "POST /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.478878 Jan 24 22:30:30.025529 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 283/570] 10.222.0.84 () {60 vars in 1322 bytes} [Mon Jan 24 22:30:29 2022] POST /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/os-volume_attachments => generated 194 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:30:30.476778 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-31dad542-9c18-46db-860c-56be992cfac4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:30.478116 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-31dad542-9c18-46db-860c-56be992cfac4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:30.486745 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-31dad542-9c18-46db-860c-56be992cfac4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:30.487396 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-31dad542-9c18-46db-860c-56be992cfac4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:30.488390 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-31dad542-9c18-46db-860c-56be992cfac4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:30.488841 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-31dad542-9c18-46db-860c-56be992cfac4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:30.638791 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-31dad542-9c18-46db-860c-56be992cfac4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:30.646771 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-31dad542-9c18-46db-860c-56be992cfac4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:30.648275 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-31dad542-9c18-46db-860c-56be992cfac4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:30.649445 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-31dad542-9c18-46db-860c-56be992cfac4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.176400 Jan 24 22:30:30.649991 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 288/571] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:30 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:30.800477 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8c7f0946-5739-404a-acb7-4138826093df tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:30.802085 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8c7f0946-5739-404a-acb7-4138826093df tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 14a5b58c-493c-46a9-a297-4fd94047866f] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:30.809376 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8c7f0946-5739-404a-acb7-4138826093df tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:30.810273 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8c7f0946-5739-404a-acb7-4138826093df tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:30.811126 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8c7f0946-5739-404a-acb7-4138826093df tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:30.811581 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8c7f0946-5739-404a-acb7-4138826093df tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:30.846431 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-8c7f0946-5739-404a-acb7-4138826093df tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] HTTP exception thrown: Instance 14a5b58c-493c-46a9-a297-4fd94047866f could not be found. Jan 24 22:30:30.847424 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8c7f0946-5739-404a-acb7-4138826093df tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Returning 404 to user: Instance 14a5b58c-493c-46a9-a297-4fd94047866f could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:30:30.848322 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8c7f0946-5739-404a-acb7-4138826093df tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f" status: 404 len: 111 microversion: 2.1 time: 0.052183 Jan 24 22:30:30.852254 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 284/572] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:30 2022] GET /compute/v2.1/servers/14a5b58c-493c-46a9-a297-4fd94047866f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:30:30.857339 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-08754689-b8cb-4288-8f65-27c5828aa936 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:30.857821 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-08754689-b8cb-4288-8f65-27c5828aa936 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:30.867052 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-08754689-b8cb-4288-8f65-27c5828aa936 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:30.867981 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-08754689-b8cb-4288-8f65-27c5828aa936 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:30.870481 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-08754689-b8cb-4288-8f65-27c5828aa936 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:30.873739 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-08754689-b8cb-4288-8f65-27c5828aa936 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:30.917345 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-08754689-b8cb-4288-8f65-27c5828aa936 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Going to try to terminate instance {{(pid=116467) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:30:31.098533 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-08754689-b8cb-4288-8f65-27c5828aa936 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "DELETE /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 204 len: 0 microversion: 2.1 time: 0.244538 Jan 24 22:30:31.099968 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 289/573] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:30:30 2022] DELETE /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:30:31.117111 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-77968e6e-779e-444d-9e8d-e1d395b52cb1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:31.118819 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-77968e6e-779e-444d-9e8d-e1d395b52cb1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:31.144092 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-77968e6e-779e-444d-9e8d-e1d395b52cb1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:31.144695 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-77968e6e-779e-444d-9e8d-e1d395b52cb1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:31.151191 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-77968e6e-779e-444d-9e8d-e1d395b52cb1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:31.151726 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-77968e6e-779e-444d-9e8d-e1d395b52cb1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:31.361427 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-77968e6e-779e-444d-9e8d-e1d395b52cb1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:31.369377 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-77968e6e-779e-444d-9e8d-e1d395b52cb1 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 200 len: 1513 microversion: 2.1 time: 0.262048 Jan 24 22:30:31.370213 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 285/574] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:31 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 1513 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:31.668281 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1a15fab0-a716-4e06-bd19-58b5b8910995 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:31.669732 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1a15fab0-a716-4e06-bd19-58b5b8910995 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:31.677243 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1a15fab0-a716-4e06-bd19-58b5b8910995 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:31.678017 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1a15fab0-a716-4e06-bd19-58b5b8910995 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:31.679045 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1a15fab0-a716-4e06-bd19-58b5b8910995 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:31.679707 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1a15fab0-a716-4e06-bd19-58b5b8910995 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:31.838515 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1a15fab0-a716-4e06-bd19-58b5b8910995 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:31.851707 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1a15fab0-a716-4e06-bd19-58b5b8910995 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:31.854484 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1a15fab0-a716-4e06-bd19-58b5b8910995 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:31.856007 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1a15fab0-a716-4e06-bd19-58b5b8910995 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1741 microversion: 2.20 time: 0.191851 Jan 24 22:30:31.868062 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 290/575] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:31 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:30:32.388737 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-634171a9-e8ea-42f0-bb6e-aaaaec2cd032 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:32.390144 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-634171a9-e8ea-42f0-bb6e-aaaaec2cd032 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:32.398424 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-634171a9-e8ea-42f0-bb6e-aaaaec2cd032 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:32.398865 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-634171a9-e8ea-42f0-bb6e-aaaaec2cd032 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:32.399960 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-634171a9-e8ea-42f0-bb6e-aaaaec2cd032 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:32.400511 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-634171a9-e8ea-42f0-bb6e-aaaaec2cd032 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:32.561634 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-634171a9-e8ea-42f0-bb6e-aaaaec2cd032 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:32.570224 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-634171a9-e8ea-42f0-bb6e-aaaaec2cd032 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 200 len: 1513 microversion: 2.1 time: 0.186288 Jan 24 22:30:32.571065 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 286/576] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:32 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:32.880252 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-bd8f4b22-ca32-4724-a85b-c95ee513b77b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:32.880845 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-bd8f4b22-ca32-4724-a85b-c95ee513b77b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:32.892051 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bd8f4b22-ca32-4724-a85b-c95ee513b77b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:32.892534 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bd8f4b22-ca32-4724-a85b-c95ee513b77b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:32.893497 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bd8f4b22-ca32-4724-a85b-c95ee513b77b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:32.894266 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bd8f4b22-ca32-4724-a85b-c95ee513b77b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:33.066457 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-bd8f4b22-ca32-4724-a85b-c95ee513b77b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:33.075701 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-bd8f4b22-ca32-4724-a85b-c95ee513b77b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:33.077211 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-bd8f4b22-ca32-4724-a85b-c95ee513b77b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:33.078535 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-bd8f4b22-ca32-4724-a85b-c95ee513b77b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1741 microversion: 2.20 time: 0.207391 Jan 24 22:30:33.090066 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 291/577] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:32 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1741 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:33.587655 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a7aa77aa-2efd-4a89-bf50-8f31ad7cc694 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:33.589019 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a7aa77aa-2efd-4a89-bf50-8f31ad7cc694 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:33.597814 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a7aa77aa-2efd-4a89-bf50-8f31ad7cc694 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:33.599326 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a7aa77aa-2efd-4a89-bf50-8f31ad7cc694 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:33.601467 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a7aa77aa-2efd-4a89-bf50-8f31ad7cc694 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:33.603809 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a7aa77aa-2efd-4a89-bf50-8f31ad7cc694 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:33.789569 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a7aa77aa-2efd-4a89-bf50-8f31ad7cc694 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:33.797163 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a7aa77aa-2efd-4a89-bf50-8f31ad7cc694 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 200 len: 1513 microversion: 2.1 time: 0.213255 Jan 24 22:30:33.809444 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 287/578] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:33 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:34.098694 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-652fa907-f4d9-4c27-9ce0-0fcbb2dfdb19 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:34.099527 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-652fa907-f4d9-4c27-9ce0-0fcbb2dfdb19 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:34.113143 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-652fa907-f4d9-4c27-9ce0-0fcbb2dfdb19 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:34.115440 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-652fa907-f4d9-4c27-9ce0-0fcbb2dfdb19 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:34.130293 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-652fa907-f4d9-4c27-9ce0-0fcbb2dfdb19 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:34.131310 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-652fa907-f4d9-4c27-9ce0-0fcbb2dfdb19 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:34.255585 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-0819d2d5-b981-4fda-804d-01956b22773b req-d8b130b1-3d78-4efe-9a33-34657f9458d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158b5aec-4d57-487e-8205-e4598e66020c", "name": "network-vif-deleted", "tag": "ca679ea3-bdcd-4fab-8f2e-e0ba60316285"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:34.257593 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:30:34.257593 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:30:34.293709 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-0819d2d5-b981-4fda-804d-01956b22773b req-d8b130b1-3d78-4efe-9a33-34657f9458d3 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:34.294293 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-0819d2d5-b981-4fda-804d-01956b22773b req-d8b130b1-3d78-4efe-9a33-34657f9458d3 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:34.324571 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-0819d2d5-b981-4fda-804d-01956b22773b req-d8b130b1-3d78-4efe-9a33-34657f9458d3 service nova] Creating event network-vif-deleted:ca679ea3-bdcd-4fab-8f2e-e0ba60316285 for instance 158b5aec-4d57-487e-8205-e4598e66020c on hv-cinder-81322 Jan 24 22:30:34.334210 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-0819d2d5-b981-4fda-804d-01956b22773b req-d8b130b1-3d78-4efe-9a33-34657f9458d3 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085744 Jan 24 22:30:34.335496 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 288/579] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:30:34.440245 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-652fa907-f4d9-4c27-9ce0-0fcbb2dfdb19 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:34.450030 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-652fa907-f4d9-4c27-9ce0-0fcbb2dfdb19 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:34.453504 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-652fa907-f4d9-4c27-9ce0-0fcbb2dfdb19 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:34.456364 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-652fa907-f4d9-4c27-9ce0-0fcbb2dfdb19 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1736 microversion: 2.20 time: 0.360990 Jan 24 22:30:34.467635 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 292/580] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:34 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1736 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:34.817928 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7377a595-00e9-482d-9f7d-2d7c314cb5da tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:34.819960 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7377a595-00e9-482d-9f7d-2d7c314cb5da tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:34.837921 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7377a595-00e9-482d-9f7d-2d7c314cb5da tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:34.838913 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7377a595-00e9-482d-9f7d-2d7c314cb5da tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:34.840266 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7377a595-00e9-482d-9f7d-2d7c314cb5da tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:34.840974 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7377a595-00e9-482d-9f7d-2d7c314cb5da tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:35.054622 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7377a595-00e9-482d-9f7d-2d7c314cb5da tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:35.055182 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7377a595-00e9-482d-9f7d-2d7c314cb5da tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:35.055922 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.objects.instance [None req-7377a595-00e9-482d-9f7d-2d7c314cb5da tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lazy-loading 'fault' on Instance uuid 158b5aec-4d57-487e-8205-e4598e66020c {{(pid=116466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:30:35.260148 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7377a595-00e9-482d-9f7d-2d7c314cb5da tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:35.275741 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7377a595-00e9-482d-9f7d-2d7c314cb5da tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 200 len: 1307 microversion: 2.1 time: 0.464127 Jan 24 22:30:35.278663 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 289/581] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:34 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 1307 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:35.487855 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-7656bfed-bdcf-4d4d-b83d-93453e73093d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:35.489143 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-7656bfed-bdcf-4d4d-b83d-93453e73093d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:35.496534 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7656bfed-bdcf-4d4d-b83d-93453e73093d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:35.497300 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7656bfed-bdcf-4d4d-b83d-93453e73093d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:35.498949 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7656bfed-bdcf-4d4d-b83d-93453e73093d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:35.499530 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7656bfed-bdcf-4d4d-b83d-93453e73093d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:35.843166 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7656bfed-bdcf-4d4d-b83d-93453e73093d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:35.854590 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7656bfed-bdcf-4d4d-b83d-93453e73093d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:35.858435 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7656bfed-bdcf-4d4d-b83d-93453e73093d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:35.864437 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-7656bfed-bdcf-4d4d-b83d-93453e73093d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1736 microversion: 2.20 time: 0.380151 Jan 24 22:30:35.865898 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 293/582] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:35 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1736 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:36.294826 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-392cca51-6cb1-4c09-a89c-65299e7989c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:36.296063 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-392cca51-6cb1-4c09-a89c-65299e7989c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 158b5aec-4d57-487e-8205-e4598e66020c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:36.303371 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-392cca51-6cb1-4c09-a89c-65299e7989c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:36.304075 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-392cca51-6cb1-4c09-a89c-65299e7989c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:36.305037 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-392cca51-6cb1-4c09-a89c-65299e7989c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:36.305604 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-392cca51-6cb1-4c09-a89c-65299e7989c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:36.321386 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-392cca51-6cb1-4c09-a89c-65299e7989c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] HTTP exception thrown: Instance 158b5aec-4d57-487e-8205-e4598e66020c could not be found. Jan 24 22:30:36.322409 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-392cca51-6cb1-4c09-a89c-65299e7989c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Returning 404 to user: Instance 158b5aec-4d57-487e-8205-e4598e66020c could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:30:36.323384 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-392cca51-6cb1-4c09-a89c-65299e7989c0 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c" status: 404 len: 111 microversion: 2.1 time: 0.032454 Jan 24 22:30:36.327148 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 290/583] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:36 2022] GET /compute/v2.1/servers/158b5aec-4d57-487e-8205-e4598e66020c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:30:36.889504 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-cccf0f08-13ab-4e9f-95b1-6cf74d3742c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:36.890686 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-cccf0f08-13ab-4e9f-95b1-6cf74d3742c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:36.901790 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cccf0f08-13ab-4e9f-95b1-6cf74d3742c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:36.902231 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cccf0f08-13ab-4e9f-95b1-6cf74d3742c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:36.905191 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cccf0f08-13ab-4e9f-95b1-6cf74d3742c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:36.905818 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cccf0f08-13ab-4e9f-95b1-6cf74d3742c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:37.048064 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-1a44ef91-fc22-4cef-96f1-f6304bf825db req-a6ad8ba2-0811-431a-8cf8-019f2dd9637a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5995cfc4-026f-45ae-a918-0bc8f1bdc025", "name": "network-vif-plugged", "status": "completed", "tag": "987c8810-0969-4e25-bb03-7993afce108d"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:37.048875 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:30:37.048875 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:30:37.093481 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-1a44ef91-fc22-4cef-96f1-f6304bf825db req-a6ad8ba2-0811-431a-8cf8-019f2dd9637a service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:37.094640 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-1a44ef91-fc22-4cef-96f1-f6304bf825db req-a6ad8ba2-0811-431a-8cf8-019f2dd9637a service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:37.142102 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-1a44ef91-fc22-4cef-96f1-f6304bf825db req-a6ad8ba2-0811-431a-8cf8-019f2dd9637a service nova] Creating event network-vif-plugged:987c8810-0969-4e25-bb03-7993afce108d for instance 5995cfc4-026f-45ae-a918-0bc8f1bdc025 on hv-cinder-81322 Jan 24 22:30:37.165371 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-1a44ef91-fc22-4cef-96f1-f6304bf825db req-a6ad8ba2-0811-431a-8cf8-019f2dd9637a service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120996 Jan 24 22:30:37.168163 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 291/584] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:30:37.551474 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-cccf0f08-13ab-4e9f-95b1-6cf74d3742c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:37.573561 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-cccf0f08-13ab-4e9f-95b1-6cf74d3742c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:37.598995 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-cccf0f08-13ab-4e9f-95b1-6cf74d3742c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:37.602813 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-d7e187ab-d728-4bcc-a92a-d6431c67c990 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:37.604752 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-cccf0f08-13ab-4e9f-95b1-6cf74d3742c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1736 microversion: 2.20 time: 0.720601 Jan 24 22:30:37.607449 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 294/585] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:36 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1736 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:30:37.608673 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d7e187ab-d728-4bcc-a92a-d6431c67c990 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:37.625056 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d7e187ab-d728-4bcc-a92a-d6431c67c990 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:37.628208 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d7e187ab-d728-4bcc-a92a-d6431c67c990 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:37.631071 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d7e187ab-d728-4bcc-a92a-d6431c67c990 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:37.632614 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d7e187ab-d728-4bcc-a92a-d6431c67c990 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:37.712125 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d7e187ab-d728-4bcc-a92a-d6431c67c990 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Going to try to terminate instance {{(pid=116466) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:30:37.937656 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ba0e8561-ddf5-49a3-a4da-5d8182d66c76 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:37.937656 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ba0e8561-ddf5-49a3-a4da-5d8182d66c76 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:37.960476 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-d7e187ab-d728-4bcc-a92a-d6431c67c990 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "DELETE /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 204 len: 0 microversion: 2.1 time: 0.366199 Jan 24 22:30:37.962121 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 292/586] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:30:37 2022] DELETE /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:30:37.975293 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-9e391279-f16e-4173-8a3e-aaa68b65f532 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:37.976134 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-9e391279-f16e-4173-8a3e-aaa68b65f532 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:37.977546 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ba0e8561-ddf5-49a3-a4da-5d8182d66c76 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:37.979608 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ba0e8561-ddf5-49a3-a4da-5d8182d66c76 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:37.987362 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9e391279-f16e-4173-8a3e-aaa68b65f532 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:37.987810 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9e391279-f16e-4173-8a3e-aaa68b65f532 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:37.988824 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ba0e8561-ddf5-49a3-a4da-5d8182d66c76 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:37.989662 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ba0e8561-ddf5-49a3-a4da-5d8182d66c76 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:37.990233 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9e391279-f16e-4173-8a3e-aaa68b65f532 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:37.991904 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9e391279-f16e-4173-8a3e-aaa68b65f532 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:38.074812 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-ba0e8561-ddf5-49a3-a4da-5d8182d66c76 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lazy-loading 'flavor' on Instance uuid a871432f-36c3-495a-8269-9de0a0e45315 {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:30:38.216235 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-9e391279-f16e-4173-8a3e-aaa68b65f532 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:38.231657 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-9e391279-f16e-4173-8a3e-aaa68b65f532 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1512 microversion: 2.1 time: 0.264046 Jan 24 22:30:38.233094 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 293/587] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:37 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:38.404485 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ba0e8561-ddf5-49a3-a4da-5d8182d66c76 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "POST /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/action" status: 200 len: 32 microversion: 2.1 time: 0.474005 Jan 24 22:30:38.411981 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 295/588] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:30:37 2022] POST /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/action => generated 32 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 22:30:38.431978 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-cd338fb7-6056-495c-90e3-56905ea4b478 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:38.431978 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-cd338fb7-6056-495c-90e3-56905ea4b478 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:38.451887 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cd338fb7-6056-495c-90e3-56905ea4b478 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:38.451887 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cd338fb7-6056-495c-90e3-56905ea4b478 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:38.452588 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cd338fb7-6056-495c-90e3-56905ea4b478 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:38.452920 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cd338fb7-6056-495c-90e3-56905ea4b478 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:38.636136 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-7d0868ae-2e09-4a0c-b494-372875585e47 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:38.638181 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-7d0868ae-2e09-4a0c-b494-372875585e47 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:38.676932 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7d0868ae-2e09-4a0c-b494-372875585e47 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:38.678284 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7d0868ae-2e09-4a0c-b494-372875585e47 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:38.680320 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7d0868ae-2e09-4a0c-b494-372875585e47 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:38.681601 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7d0868ae-2e09-4a0c-b494-372875585e47 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:38.782696 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-cd338fb7-6056-495c-90e3-56905ea4b478 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:38.804132 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-cd338fb7-6056-495c-90e3-56905ea4b478 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1568 microversion: 2.1 time: 0.388905 Jan 24 22:30:38.809930 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 294/589] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:38 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1568 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:38.981437 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c2fef920-d43b-4d0e-95ad-e0d772244a79 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-534470415", "imageRef": "4fe12948-6887-4759-900b-f3ee39409e75", "flavorRef": "452", "networks": [{"uuid": "e8888219-d5d2-46f9-84f1-df880fd5a58a"}]}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:39.074624 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7d0868ae-2e09-4a0c-b494-372875585e47 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:39.090190 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7d0868ae-2e09-4a0c-b494-372875585e47 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:39.095002 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7d0868ae-2e09-4a0c-b494-372875585e47 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:39.098646 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-7d0868ae-2e09-4a0c-b494-372875585e47 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1736 microversion: 2.20 time: 0.470861 Jan 24 22:30:39.107871 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 296/590] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:38 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1736 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:39.252272 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ae97a036-7725-4e3c-8146-4029a716da0c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:39.254353 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ae97a036-7725-4e3c-8146-4029a716da0c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:39.271124 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ae97a036-7725-4e3c-8146-4029a716da0c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:39.271969 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ae97a036-7725-4e3c-8146-4029a716da0c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:39.273184 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ae97a036-7725-4e3c-8146-4029a716da0c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:39.273829 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ae97a036-7725-4e3c-8146-4029a716da0c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:39.507354 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ae97a036-7725-4e3c-8146-4029a716da0c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:39.518635 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ae97a036-7725-4e3c-8146-4029a716da0c tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1512 microversion: 2.1 time: 0.270669 Jan 24 22:30:39.528947 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 297/591] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:39 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:30:39.838167 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b6ed1384-0cea-47a4-b858-6ce61900d429 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:39.838754 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b6ed1384-0cea-47a4-b858-6ce61900d429 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:39.851600 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b6ed1384-0cea-47a4-b858-6ce61900d429 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:39.852501 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b6ed1384-0cea-47a4-b858-6ce61900d429 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:39.853518 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b6ed1384-0cea-47a4-b858-6ce61900d429 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:39.854097 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b6ed1384-0cea-47a4-b858-6ce61900d429 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:40.108801 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b6ed1384-0cea-47a4-b858-6ce61900d429 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:40.117444 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b6ed1384-0cea-47a4-b858-6ce61900d429 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1568 microversion: 2.1 time: 0.294987 Jan 24 22:30:40.128465 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 298/592] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:39 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:40.145236 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4e72d3ee-92b2-4aae-8998-0a73a225cafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:40.146229 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4e72d3ee-92b2-4aae-8998-0a73a225cafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:40.160438 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4e72d3ee-92b2-4aae-8998-0a73a225cafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:40.161166 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4e72d3ee-92b2-4aae-8998-0a73a225cafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:40.163318 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4e72d3ee-92b2-4aae-8998-0a73a225cafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:40.163856 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4e72d3ee-92b2-4aae-8998-0a73a225cafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:40.412289 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4e72d3ee-92b2-4aae-8998-0a73a225cafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:40.423941 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4e72d3ee-92b2-4aae-8998-0a73a225cafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:40.425665 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4e72d3ee-92b2-4aae-8998-0a73a225cafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:40.427459 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4e72d3ee-92b2-4aae-8998-0a73a225cafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1736 microversion: 2.20 time: 0.297346 Jan 24 22:30:40.429053 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 299/593] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:40 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1736 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:40.536310 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e52acd6e-28d9-418f-b8d7-ea1a15b33f4f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:40.537038 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e52acd6e-28d9-418f-b8d7-ea1a15b33f4f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:40.550942 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e52acd6e-28d9-418f-b8d7-ea1a15b33f4f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:40.551980 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e52acd6e-28d9-418f-b8d7-ea1a15b33f4f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:40.553016 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e52acd6e-28d9-418f-b8d7-ea1a15b33f4f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:40.557180 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e52acd6e-28d9-418f-b8d7-ea1a15b33f4f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:40.905587 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e52acd6e-28d9-418f-b8d7-ea1a15b33f4f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:40.915078 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e52acd6e-28d9-418f-b8d7-ea1a15b33f4f tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1512 microversion: 2.1 time: 0.381177 Jan 24 22:30:40.915302 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 300/594] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:40 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:41.135069 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a49c526f-f19d-419e-a523-b5b83ffc8d09 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:41.136332 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a49c526f-f19d-419e-a523-b5b83ffc8d09 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:41.151897 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a49c526f-f19d-419e-a523-b5b83ffc8d09 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:41.152620 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a49c526f-f19d-419e-a523-b5b83ffc8d09 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:41.153650 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a49c526f-f19d-419e-a523-b5b83ffc8d09 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:41.154087 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a49c526f-f19d-419e-a523-b5b83ffc8d09 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:41.426311 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a49c526f-f19d-419e-a523-b5b83ffc8d09 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:41.447248 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a49c526f-f19d-419e-a523-b5b83ffc8d09 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1568 microversion: 2.1 time: 0.310985 Jan 24 22:30:41.450175 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 301/595] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:41 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1568 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:41.460094 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-d57f22f5-30de-4cc5-9955-a642a3a60eba req-f3735817-359a-47ca-957e-95f08541b2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179be558-5543-42db-b299-8115c58cf1e5", "name": "network-vif-deleted", "tag": "0843b280-c8c5-4405-93c7-2ba198e91f41"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:41.471109 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:30:41.471109 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:30:41.492453 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-d57f22f5-30de-4cc5-9955-a642a3a60eba req-f3735817-359a-47ca-957e-95f08541b2bc service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:41.494980 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-d57f22f5-30de-4cc5-9955-a642a3a60eba req-f3735817-359a-47ca-957e-95f08541b2bc service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:41.534010 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-d57f22f5-30de-4cc5-9955-a642a3a60eba req-f3735817-359a-47ca-957e-95f08541b2bc service nova] Creating event network-vif-deleted:0843b280-c8c5-4405-93c7-2ba198e91f41 for instance 179be558-5543-42db-b299-8115c58cf1e5 on hv-cinder-81322 Jan 24 22:30:41.545284 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-d57f22f5-30de-4cc5-9955-a642a3a60eba req-f3735817-359a-47ca-957e-95f08541b2bc service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094022 Jan 24 22:30:41.550550 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 302/596] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:30:41.557320 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-14d7ada6-f83f-4853-b0cb-8ae230fb79b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:41.558011 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-14d7ada6-f83f-4853-b0cb-8ae230fb79b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:41.568216 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-14d7ada6-f83f-4853-b0cb-8ae230fb79b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:41.569359 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-14d7ada6-f83f-4853-b0cb-8ae230fb79b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:41.569728 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-14d7ada6-f83f-4853-b0cb-8ae230fb79b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:41.570156 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-14d7ada6-f83f-4853-b0cb-8ae230fb79b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:41.820715 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-14d7ada6-f83f-4853-b0cb-8ae230fb79b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:41.840854 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-14d7ada6-f83f-4853-b0cb-8ae230fb79b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:41.842735 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-14d7ada6-f83f-4853-b0cb-8ae230fb79b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:41.850856 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-14d7ada6-f83f-4853-b0cb-8ae230fb79b8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1736 microversion: 2.20 time: 0.292872 Jan 24 22:30:41.855645 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 303/597] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:41 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1736 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:41.933738 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-bbeb57f5-dc69-4856-b425-bcac9e586506 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:41.934729 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-bbeb57f5-dc69-4856-b425-bcac9e586506 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:41.946735 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bbeb57f5-dc69-4856-b425-bcac9e586506 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:41.948216 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bbeb57f5-dc69-4856-b425-bcac9e586506 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:41.949296 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bbeb57f5-dc69-4856-b425-bcac9e586506 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:41.968425 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bbeb57f5-dc69-4856-b425-bcac9e586506 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:42.056914 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bbeb57f5-dc69-4856-b425-bcac9e586506 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:42.060791 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-bbeb57f5-dc69-4856-b425-bcac9e586506 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:42.066772 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-bbeb57f5-dc69-4856-b425-bcac9e586506 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lazy-loading 'fault' on Instance uuid 179be558-5543-42db-b299-8115c58cf1e5 {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:30:42.171140 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-bbeb57f5-dc69-4856-b425-bcac9e586506 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f51c8d0b8c4cc5ab76dae765c1b1c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78218846bb84713b4c02d9f95a25250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:42.192278 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-bbeb57f5-dc69-4856-b425-bcac9e586506 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 200 len: 1307 microversion: 2.1 time: 0.263700 Jan 24 22:30:42.193522 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 304/598] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:41 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 1307 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:30:42.476880 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-47f96470-3d24-4711-b81f-03733600ae23 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:42.480223 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-47f96470-3d24-4711-b81f-03733600ae23 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:42.490977 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-47f96470-3d24-4711-b81f-03733600ae23 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:42.491416 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-47f96470-3d24-4711-b81f-03733600ae23 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:42.492203 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-47f96470-3d24-4711-b81f-03733600ae23 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:42.492636 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-47f96470-3d24-4711-b81f-03733600ae23 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:42.707138 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-47f96470-3d24-4711-b81f-03733600ae23 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:42.724722 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-47f96470-3d24-4711-b81f-03733600ae23 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1568 microversion: 2.1 time: 0.260751 Jan 24 22:30:42.729878 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 305/599] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:42 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1568 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:42.879060 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e2e85f50-a39f-4172-9d31-978ce7f70610 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:42.901906 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e2e85f50-a39f-4172-9d31-978ce7f70610 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:42.925472 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e2e85f50-a39f-4172-9d31-978ce7f70610 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:42.926591 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e2e85f50-a39f-4172-9d31-978ce7f70610 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:42.929082 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e2e85f50-a39f-4172-9d31-978ce7f70610 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:42.929799 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e2e85f50-a39f-4172-9d31-978ce7f70610 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:43.326266 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e2e85f50-a39f-4172-9d31-978ce7f70610 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:43.345010 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e2e85f50-a39f-4172-9d31-978ce7f70610 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:43.351399 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e2e85f50-a39f-4172-9d31-978ce7f70610 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:43.364325 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e2e85f50-a39f-4172-9d31-978ce7f70610 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1736 microversion: 2.20 time: 0.486139 Jan 24 22:30:43.373447 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 306/600] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:42 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1736 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:43.389273 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6bac2ee2-2f44-4929-b622-c7f609dab776 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:43.390422 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6bac2ee2-2f44-4929-b622-c7f609dab776 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] [instance: 179be558-5543-42db-b299-8115c58cf1e5] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:43.423661 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6bac2ee2-2f44-4929-b622-c7f609dab776 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:43.424535 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6bac2ee2-2f44-4929-b622-c7f609dab776 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:43.425609 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6bac2ee2-2f44-4929-b622-c7f609dab776 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:43.426308 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6bac2ee2-2f44-4929-b622-c7f609dab776 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:43.453503 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-6bac2ee2-2f44-4929-b622-c7f609dab776 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] HTTP exception thrown: Instance 179be558-5543-42db-b299-8115c58cf1e5 could not be found. Jan 24 22:30:43.455060 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6bac2ee2-2f44-4929-b622-c7f609dab776 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] Returning 404 to user: Instance 179be558-5543-42db-b299-8115c58cf1e5 could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:30:43.456925 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6bac2ee2-2f44-4929-b622-c7f609dab776 tempest-AttachVolumeNegativeTest-1341247169 tempest-AttachVolumeNegativeTest-1341247169-project] 10.222.0.84 "GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5" status: 404 len: 111 microversion: 2.1 time: 0.082155 Jan 24 22:30:43.458163 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 307/601] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:43 2022] GET /compute/v2.1/servers/179be558-5543-42db-b299-8115c58cf1e5 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:30:43.744806 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c9e473b8-f16a-4dd1-b813-8f91c4e81983 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:43.745501 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c9e473b8-f16a-4dd1-b813-8f91c4e81983 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:43.754159 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c9e473b8-f16a-4dd1-b813-8f91c4e81983 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:43.754555 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c9e473b8-f16a-4dd1-b813-8f91c4e81983 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:43.755347 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c9e473b8-f16a-4dd1-b813-8f91c4e81983 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:43.755803 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c9e473b8-f16a-4dd1-b813-8f91c4e81983 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:44.216060 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-c9e473b8-f16a-4dd1-b813-8f91c4e81983 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:44.229602 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c9e473b8-f16a-4dd1-b813-8f91c4e81983 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1568 microversion: 2.1 time: 0.490321 Jan 24 22:30:44.234510 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 308/602] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:43 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1568 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:44.398949 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-d429d68c-fcd7-4c37-9564-45046649dc1a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:44.400258 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-d429d68c-fcd7-4c37-9564-45046649dc1a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:44.410802 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d429d68c-fcd7-4c37-9564-45046649dc1a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:44.411720 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d429d68c-fcd7-4c37-9564-45046649dc1a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:44.412921 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d429d68c-fcd7-4c37-9564-45046649dc1a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:44.417056 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d429d68c-fcd7-4c37-9564-45046649dc1a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:45.040945 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-d429d68c-fcd7-4c37-9564-45046649dc1a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:45.050170 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-d429d68c-fcd7-4c37-9564-45046649dc1a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:45.056662 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-d429d68c-fcd7-4c37-9564-45046649dc1a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:45.059664 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-d429d68c-fcd7-4c37-9564-45046649dc1a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1736 microversion: 2.20 time: 0.662216 Jan 24 22:30:45.060639 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 309/603] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:44 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1736 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:45.255329 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a0a005a0-ee48-4eae-a5e6-f22b0c6db606 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:45.255329 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a0a005a0-ee48-4eae-a5e6-f22b0c6db606 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:45.274222 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a0a005a0-ee48-4eae-a5e6-f22b0c6db606 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:45.274656 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a0a005a0-ee48-4eae-a5e6-f22b0c6db606 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:45.275456 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a0a005a0-ee48-4eae-a5e6-f22b0c6db606 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:45.275883 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a0a005a0-ee48-4eae-a5e6-f22b0c6db606 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:45.649146 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a0a005a0-ee48-4eae-a5e6-f22b0c6db606 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:45.659856 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a0a005a0-ee48-4eae-a5e6-f22b0c6db606 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1568 microversion: 2.1 time: 0.411999 Jan 24 22:30:45.664487 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 310/604] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:45 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1568 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:46.086156 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-37451872-5a91-4d26-90f6-ea352edf86eb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:46.087247 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-37451872-5a91-4d26-90f6-ea352edf86eb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:46.099532 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-37451872-5a91-4d26-90f6-ea352edf86eb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:46.100517 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-37451872-5a91-4d26-90f6-ea352edf86eb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:46.101673 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-37451872-5a91-4d26-90f6-ea352edf86eb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:46.102315 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-37451872-5a91-4d26-90f6-ea352edf86eb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:46.470485 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-37451872-5a91-4d26-90f6-ea352edf86eb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:46.487071 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-37451872-5a91-4d26-90f6-ea352edf86eb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:46.496839 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-37451872-5a91-4d26-90f6-ea352edf86eb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:46.501905 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-37451872-5a91-4d26-90f6-ea352edf86eb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1736 microversion: 2.20 time: 0.419827 Jan 24 22:30:46.515485 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 311/605] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:46 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1736 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:46.683320 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2cf3d892-e96a-4b06-a069-a54492db21c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:46.683965 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2cf3d892-e96a-4b06-a069-a54492db21c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:46.704782 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2cf3d892-e96a-4b06-a069-a54492db21c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:46.708612 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2cf3d892-e96a-4b06-a069-a54492db21c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:46.710270 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2cf3d892-e96a-4b06-a069-a54492db21c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:46.710864 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2cf3d892-e96a-4b06-a069-a54492db21c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:47.067474 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2cf3d892-e96a-4b06-a069-a54492db21c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:47.097478 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2cf3d892-e96a-4b06-a069-a54492db21c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1568 microversion: 2.1 time: 0.418397 Jan 24 22:30:47.118264 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 312/606] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:46 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1568 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:47.531756 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-798785c5-0831-4abd-a7ec-b6538a9971a0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:47.532873 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-798785c5-0831-4abd-a7ec-b6538a9971a0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:47.543930 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-798785c5-0831-4abd-a7ec-b6538a9971a0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:47.544801 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-798785c5-0831-4abd-a7ec-b6538a9971a0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:47.546844 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-798785c5-0831-4abd-a7ec-b6538a9971a0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:47.547842 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-798785c5-0831-4abd-a7ec-b6538a9971a0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:47.823533 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-798785c5-0831-4abd-a7ec-b6538a9971a0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:47.845866 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-798785c5-0831-4abd-a7ec-b6538a9971a0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:47.848512 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-798785c5-0831-4abd-a7ec-b6538a9971a0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:47.850633 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-798785c5-0831-4abd-a7ec-b6538a9971a0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1736 microversion: 2.20 time: 0.325997 Jan 24 22:30:47.859083 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 313/607] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:47 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1736 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:48.126783 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-00be8612-4e0a-4c3a-b36d-937490afc335 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:48.127727 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-00be8612-4e0a-4c3a-b36d-937490afc335 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:48.147438 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-00be8612-4e0a-4c3a-b36d-937490afc335 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:48.152330 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-00be8612-4e0a-4c3a-b36d-937490afc335 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:48.153471 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-00be8612-4e0a-4c3a-b36d-937490afc335 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:48.155926 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-00be8612-4e0a-4c3a-b36d-937490afc335 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:48.570531 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-00be8612-4e0a-4c3a-b36d-937490afc335 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:48.641015 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-00be8612-4e0a-4c3a-b36d-937490afc335 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1568 microversion: 2.1 time: 0.512617 Jan 24 22:30:48.641015 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 314/608] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:48 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1568 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:48.873350 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-89705db5-585d-40f8-9a5c-ba55911f952e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:48.873350 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-89705db5-585d-40f8-9a5c-ba55911f952e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:48.889022 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-89705db5-585d-40f8-9a5c-ba55911f952e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:48.889022 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-89705db5-585d-40f8-9a5c-ba55911f952e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:48.889022 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-89705db5-585d-40f8-9a5c-ba55911f952e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:48.917221 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-89705db5-585d-40f8-9a5c-ba55911f952e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:49.197605 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-89705db5-585d-40f8-9a5c-ba55911f952e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:49.210958 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-89705db5-585d-40f8-9a5c-ba55911f952e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:49.214589 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-89705db5-585d-40f8-9a5c-ba55911f952e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:49.217480 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-89705db5-585d-40f8-9a5c-ba55911f952e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1736 microversion: 2.20 time: 0.349657 Jan 24 22:30:49.218395 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 315/609] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:48 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1736 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:49.661077 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-92d9c2eb-28f9-4ff7-bc38-693c1c5cd7b7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:49.661651 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-92d9c2eb-28f9-4ff7-bc38-693c1c5cd7b7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:49.678490 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-92d9c2eb-28f9-4ff7-bc38-693c1c5cd7b7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:49.679043 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-92d9c2eb-28f9-4ff7-bc38-693c1c5cd7b7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:49.682163 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-92d9c2eb-28f9-4ff7-bc38-693c1c5cd7b7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:49.698223 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-92d9c2eb-28f9-4ff7-bc38-693c1c5cd7b7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:49.964116 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-92d9c2eb-28f9-4ff7-bc38-693c1c5cd7b7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:49.978284 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-92d9c2eb-28f9-4ff7-bc38-693c1c5cd7b7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1568 microversion: 2.1 time: 0.324162 Jan 24 22:30:49.979319 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 316/610] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:49 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1568 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:50.224605 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.network.neutron [None req-c2fef920-d43b-4d0e-95ad-e0d772244a79 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] validate_networks() for [('e8888219-d5d2-46f9-84f1-df880fd5a58a', None, None, None, None, None)] {{(pid=116466) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:30:50.242167 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-66d3ebb8-2e39-4709-a7f6-820f43730061 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:50.244247 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-66d3ebb8-2e39-4709-a7f6-820f43730061 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:50.267610 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-66d3ebb8-2e39-4709-a7f6-820f43730061 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:50.269100 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-66d3ebb8-2e39-4709-a7f6-820f43730061 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:50.270950 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-66d3ebb8-2e39-4709-a7f6-820f43730061 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:50.271906 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-66d3ebb8-2e39-4709-a7f6-820f43730061 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:50.482935 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-66d3ebb8-2e39-4709-a7f6-820f43730061 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:50.494259 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-66d3ebb8-2e39-4709-a7f6-820f43730061 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:50.496355 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-66d3ebb8-2e39-4709-a7f6-820f43730061 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:50.498353 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-66d3ebb8-2e39-4709-a7f6-820f43730061 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1736 microversion: 2.20 time: 0.266142 Jan 24 22:30:50.499436 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 317/611] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:50 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1736 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:50.726087 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-c2fef920-d43b-4d0e-95ad-e0d772244a79 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Flavor limits 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:30:50.726674 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-c2fef920-d43b-4d0e-95ad-e0d772244a79 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Image limits 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:30:50.727332 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-c2fef920-d43b-4d0e-95ad-e0d772244a79 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Flavor pref 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:30:50.727947 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-c2fef920-d43b-4d0e-95ad-e0d772244a79 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Image pref 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:30:50.728315 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-c2fef920-d43b-4d0e-95ad-e0d772244a79 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:30:50.744707 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c2fef920-d43b-4d0e-95ad-e0d772244a79 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:50.746194 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c2fef920-d43b-4d0e-95ad-e0d772244a79 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:50.747234 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c2fef920-d43b-4d0e-95ad-e0d772244a79 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:50.747669 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c2fef920-d43b-4d0e-95ad-e0d772244a79 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:50.778022 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-c2fef920-d43b-4d0e-95ad-e0d772244a79 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Getting quotas for project cc5a655a0b0f4f0482453bde6f196195. Resources: {'cores', 'instances', 'ram'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:30:50.784117 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-c2fef920-d43b-4d0e-95ad-e0d772244a79 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Getting quotas for user 9b4ada062ed8433da1795195691f241c and project cc5a655a0b0f4f0482453bde6f196195. Resources: {'cores', 'instances', 'ram'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:30:50.799472 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c2fef920-d43b-4d0e-95ad-e0d772244a79 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Going to run 1 instances... {{(pid=116466) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:30:50.803029 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c2fef920-d43b-4d0e-95ad-e0d772244a79 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fe12948-6887-4759-900b-f3ee39409e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:30:50.898298 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c2fef920-d43b-4d0e-95ad-e0d772244a79 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.921004 Jan 24 22:30:50.901483 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 295/612] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:30:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 11926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 24 22:30:50.915191 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-369e2a70-1a03-4ba1-8c21-0776864f49de tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:50.915809 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-369e2a70-1a03-4ba1-8c21-0776864f49de tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:50.971172 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-369e2a70-1a03-4ba1-8c21-0776864f49de tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:50.984887 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-369e2a70-1a03-4ba1-8c21-0776864f49de tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1218 microversion: 2.1 time: 0.075340 Jan 24 22:30:50.985869 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 318/613] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:50 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:51.007815 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e96956fe-1c7d-4ccd-ab42-4fbfdab576cf tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:51.008660 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e96956fe-1c7d-4ccd-ab42-4fbfdab576cf tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:51.015370 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e96956fe-1c7d-4ccd-ab42-4fbfdab576cf tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:51.016717 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e96956fe-1c7d-4ccd-ab42-4fbfdab576cf tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:51.017786 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e96956fe-1c7d-4ccd-ab42-4fbfdab576cf tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:51.018449 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e96956fe-1c7d-4ccd-ab42-4fbfdab576cf tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:51.284444 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e96956fe-1c7d-4ccd-ab42-4fbfdab576cf tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:51.304416 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e96956fe-1c7d-4ccd-ab42-4fbfdab576cf tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1568 microversion: 2.1 time: 0.297606 Jan 24 22:30:51.305225 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 296/614] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:51 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1568 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:30:51.522395 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1464012d-3651-4047-8724-ccd2934e090a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:51.523394 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1464012d-3651-4047-8724-ccd2934e090a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:51.535241 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1464012d-3651-4047-8724-ccd2934e090a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:51.535975 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1464012d-3651-4047-8724-ccd2934e090a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:51.537163 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1464012d-3651-4047-8724-ccd2934e090a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:51.538774 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1464012d-3651-4047-8724-ccd2934e090a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:51.872848 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1464012d-3651-4047-8724-ccd2934e090a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:51.884767 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1464012d-3651-4047-8724-ccd2934e090a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:51.886332 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1464012d-3651-4047-8724-ccd2934e090a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:51.892414 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1464012d-3651-4047-8724-ccd2934e090a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1718 microversion: 2.20 time: 0.370008 Jan 24 22:30:51.894678 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 319/615] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:51 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1718 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:52.033973 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1798490a-c08f-4a60-8bca-6bdff8cfafb4 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:52.036883 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-1798490a-c08f-4a60-8bca-6bdff8cfafb4 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:52.079486 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1798490a-c08f-4a60-8bca-6bdff8cfafb4 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:52.080879 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1798490a-c08f-4a60-8bca-6bdff8cfafb4 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:52.081732 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1798490a-c08f-4a60-8bca-6bdff8cfafb4 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:52.082171 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1798490a-c08f-4a60-8bca-6bdff8cfafb4 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:52.162126 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-1798490a-c08f-4a60-8bca-6bdff8cfafb4 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:52.170529 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-1798490a-c08f-4a60-8bca-6bdff8cfafb4 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1270 microversion: 2.1 time: 0.166491 Jan 24 22:30:52.171345 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 297/616] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:51 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:52.323103 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-52bf21ca-b1bf-497c-8cc6-b157353d3fcf tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:52.323826 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-52bf21ca-b1bf-497c-8cc6-b157353d3fcf tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:52.336762 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-52bf21ca-b1bf-497c-8cc6-b157353d3fcf tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:52.337344 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-52bf21ca-b1bf-497c-8cc6-b157353d3fcf tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:52.338751 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-52bf21ca-b1bf-497c-8cc6-b157353d3fcf tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:52.339402 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-52bf21ca-b1bf-497c-8cc6-b157353d3fcf tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:52.622750 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-52bf21ca-b1bf-497c-8cc6-b157353d3fcf tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:52.631613 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-52bf21ca-b1bf-497c-8cc6-b157353d3fcf tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1568 microversion: 2.1 time: 0.312703 Jan 24 22:30:52.641578 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 320/617] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:52 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1568 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:52.913316 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2651706f-686f-43a2-be95-e3c9faddeffe tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:52.914608 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2651706f-686f-43a2-be95-e3c9faddeffe tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:52.920860 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2651706f-686f-43a2-be95-e3c9faddeffe tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:52.921556 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2651706f-686f-43a2-be95-e3c9faddeffe tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:52.922462 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2651706f-686f-43a2-be95-e3c9faddeffe tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:52.922893 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2651706f-686f-43a2-be95-e3c9faddeffe tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:53.073752 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-2651706f-686f-43a2-be95-e3c9faddeffe tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:53.082842 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-2651706f-686f-43a2-be95-e3c9faddeffe tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:53.084444 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-2651706f-686f-43a2-be95-e3c9faddeffe tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:53.086308 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2651706f-686f-43a2-be95-e3c9faddeffe tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1718 microversion: 2.20 time: 0.176695 Jan 24 22:30:53.086526 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 298/618] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:52 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1718 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:30:53.187723 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c3803116-85c9-453e-b4e4-17ca55d58922 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:53.188341 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c3803116-85c9-453e-b4e4-17ca55d58922 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:53.196922 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c3803116-85c9-453e-b4e4-17ca55d58922 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:53.197427 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c3803116-85c9-453e-b4e4-17ca55d58922 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:53.198287 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c3803116-85c9-453e-b4e4-17ca55d58922 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:53.198605 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c3803116-85c9-453e-b4e4-17ca55d58922 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:53.277745 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-c3803116-85c9-453e-b4e4-17ca55d58922 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:53.285735 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c3803116-85c9-453e-b4e4-17ca55d58922 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1276 microversion: 2.1 time: 0.101762 Jan 24 22:30:53.296269 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 321/619] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:53 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1276 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:53.651064 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3b35fa7d-7010-4273-9f6f-d6ee5d509594 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:53.651792 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3b35fa7d-7010-4273-9f6f-d6ee5d509594 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:53.659274 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3b35fa7d-7010-4273-9f6f-d6ee5d509594 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:53.665629 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3b35fa7d-7010-4273-9f6f-d6ee5d509594 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:53.666817 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3b35fa7d-7010-4273-9f6f-d6ee5d509594 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:53.667496 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3b35fa7d-7010-4273-9f6f-d6ee5d509594 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:53.925083 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3b35fa7d-7010-4273-9f6f-d6ee5d509594 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:53.937690 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3b35fa7d-7010-4273-9f6f-d6ee5d509594 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1568 microversion: 2.1 time: 0.291145 Jan 24 22:30:53.938520 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 299/620] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:53 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1568 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:54.104635 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-8f52f8be-fcea-4f44-80a3-915f4054eafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:54.105271 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-8f52f8be-fcea-4f44-80a3-915f4054eafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:54.111925 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8f52f8be-fcea-4f44-80a3-915f4054eafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:54.112367 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8f52f8be-fcea-4f44-80a3-915f4054eafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:54.113355 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8f52f8be-fcea-4f44-80a3-915f4054eafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:54.113789 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8f52f8be-fcea-4f44-80a3-915f4054eafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:54.312199 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-37449c98-753a-4366-a99c-fd2e9fbfb06f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:54.313290 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-37449c98-753a-4366-a99c-fd2e9fbfb06f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:54.325605 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-37449c98-753a-4366-a99c-fd2e9fbfb06f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:54.326317 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-37449c98-753a-4366-a99c-fd2e9fbfb06f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:54.327316 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-37449c98-753a-4366-a99c-fd2e9fbfb06f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:54.327906 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-37449c98-753a-4366-a99c-fd2e9fbfb06f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:54.358128 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-8f52f8be-fcea-4f44-80a3-915f4054eafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:54.369097 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-8f52f8be-fcea-4f44-80a3-915f4054eafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:54.371264 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-8f52f8be-fcea-4f44-80a3-915f4054eafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:54.372820 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-8f52f8be-fcea-4f44-80a3-915f4054eafc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1718 microversion: 2.20 time: 0.272059 Jan 24 22:30:54.373435 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 322/621] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:54 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1718 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:54.457568 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-6cf8a14b-8f64-4c99-8661-1c113a24f8d3 req-d9933448-42d1-4b5b-a7b4-38eae3e7c094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f960b38f-f542-4b02-972e-f0c17fe05d4c", "tag": "3b795779-9a59-417a-a073-f7d208152ddb"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:54.459158 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:30:54.459158 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:30:54.483005 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-6cf8a14b-8f64-4c99-8661-1c113a24f8d3 req-d9933448-42d1-4b5b-a7b4-38eae3e7c094 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:54.483643 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-6cf8a14b-8f64-4c99-8661-1c113a24f8d3 req-d9933448-42d1-4b5b-a7b4-38eae3e7c094 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:54.510947 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-6cf8a14b-8f64-4c99-8661-1c113a24f8d3 req-d9933448-42d1-4b5b-a7b4-38eae3e7c094 service nova] Creating event network-changed:3b795779-9a59-417a-a073-f7d208152ddb for instance f960b38f-f542-4b02-972e-f0c17fe05d4c on hv-cinder-81322 Jan 24 22:30:54.519810 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-6cf8a14b-8f64-4c99-8661-1c113a24f8d3 req-d9933448-42d1-4b5b-a7b4-38eae3e7c094 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066635 Jan 24 22:30:54.523487 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 323/622] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:30:54.547435 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-37449c98-753a-4366-a99c-fd2e9fbfb06f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:54.556321 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-37449c98-753a-4366-a99c-fd2e9fbfb06f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1318 microversion: 2.1 time: 0.255553 Jan 24 22:30:54.566700 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 300/623] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:54 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:54.956241 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-7e72b025-2286-47fc-b182-4c97052386da tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:54.957731 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-7e72b025-2286-47fc-b182-4c97052386da tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:54.966255 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7e72b025-2286-47fc-b182-4c97052386da tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:54.967377 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7e72b025-2286-47fc-b182-4c97052386da tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:54.968858 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7e72b025-2286-47fc-b182-4c97052386da tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:54.969609 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7e72b025-2286-47fc-b182-4c97052386da tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:55.126817 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7e72b025-2286-47fc-b182-4c97052386da tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:55.136624 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-7e72b025-2286-47fc-b182-4c97052386da tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1568 microversion: 2.1 time: 0.185275 Jan 24 22:30:55.137740 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 324/624] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:54 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:55.392224 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-bd41ba03-776d-4d65-89cd-b21977a773ca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:55.392890 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-bd41ba03-776d-4d65-89cd-b21977a773ca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:55.400115 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bd41ba03-776d-4d65-89cd-b21977a773ca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:55.400631 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bd41ba03-776d-4d65-89cd-b21977a773ca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:55.401501 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bd41ba03-776d-4d65-89cd-b21977a773ca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:55.402137 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bd41ba03-776d-4d65-89cd-b21977a773ca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:55.544582 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-bd41ba03-776d-4d65-89cd-b21977a773ca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:55.553705 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-bd41ba03-776d-4d65-89cd-b21977a773ca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:55.555524 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-bd41ba03-776d-4d65-89cd-b21977a773ca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:55.556749 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-bd41ba03-776d-4d65-89cd-b21977a773ca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1661 microversion: 2.20 time: 0.168503 Jan 24 22:30:55.557338 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 301/625] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:55 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1661 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:55.574623 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-028c9613-c44c-4e9c-93ff-d22525a04460 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:55.575416 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-028c9613-c44c-4e9c-93ff-d22525a04460 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:55.581444 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8fea63a4-33f4-4340-af6e-81856303cebd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "245cf039-fa8f-49c9-9dea-adf383ffad5b"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:55.581713 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-028c9613-c44c-4e9c-93ff-d22525a04460 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:55.582163 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-028c9613-c44c-4e9c-93ff-d22525a04460 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:55.582565 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8fea63a4-33f4-4340-af6e-81856303cebd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:55.582950 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-028c9613-c44c-4e9c-93ff-d22525a04460 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:55.583382 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-028c9613-c44c-4e9c-93ff-d22525a04460 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:55.590727 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8fea63a4-33f4-4340-af6e-81856303cebd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:55.591419 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8fea63a4-33f4-4340-af6e-81856303cebd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:55.592201 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8fea63a4-33f4-4340-af6e-81856303cebd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:55.592626 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8fea63a4-33f4-4340-af6e-81856303cebd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:55.746067 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-028c9613-c44c-4e9c-93ff-d22525a04460 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:55.755571 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-028c9613-c44c-4e9c-93ff-d22525a04460 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1318 microversion: 2.1 time: 0.185102 Jan 24 22:30:55.756421 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 325/626] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:55 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:55.920616 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8fea63a4-33f4-4340-af6e-81856303cebd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.346503 Jan 24 22:30:55.921364 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 302/627] 10.222.0.84 () {62 vars in 1363 bytes} [Mon Jan 24 22:30:55 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/os-volume_attachments => generated 188 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:30:56.032855 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f6d63688-59e5-4d5f-8162-ec49c5ce9e24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:56.033586 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-f6d63688-59e5-4d5f-8162-ec49c5ce9e24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:56.041773 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f6d63688-59e5-4d5f-8162-ec49c5ce9e24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:56.042220 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f6d63688-59e5-4d5f-8162-ec49c5ce9e24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:56.043041 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f6d63688-59e5-4d5f-8162-ec49c5ce9e24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:56.044646 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f6d63688-59e5-4d5f-8162-ec49c5ce9e24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:56.137449 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-f6d63688-59e5-4d5f-8162-ec49c5ce9e24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action" status: 202 len: 0 microversion: 2.20 time: 0.107979 Jan 24 22:30:56.138326 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 326/628] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:30:56 2022] POST /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:30:56.147238 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ee01edb4-fbbf-47c8-b852-1d77a86b8211 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:56.147812 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ee01edb4-fbbf-47c8-b852-1d77a86b8211 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:56.154446 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ee01edb4-fbbf-47c8-b852-1d77a86b8211 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:56.154808 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ee01edb4-fbbf-47c8-b852-1d77a86b8211 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:56.155634 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ee01edb4-fbbf-47c8-b852-1d77a86b8211 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:56.156041 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ee01edb4-fbbf-47c8-b852-1d77a86b8211 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:56.159038 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f6a1908d-37f3-42a5-8574-b486591e8e5c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:56.159995 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-f6a1908d-37f3-42a5-8574-b486591e8e5c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:56.167410 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f6a1908d-37f3-42a5-8574-b486591e8e5c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:56.167990 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f6a1908d-37f3-42a5-8574-b486591e8e5c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:56.168941 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f6a1908d-37f3-42a5-8574-b486591e8e5c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:56.169684 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f6a1908d-37f3-42a5-8574-b486591e8e5c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:56.433477 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ee01edb4-fbbf-47c8-b852-1d77a86b8211 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:56.442750 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ee01edb4-fbbf-47c8-b852-1d77a86b8211 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:56.444891 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-f6a1908d-37f3-42a5-8574-b486591e8e5c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:56.448424 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ee01edb4-fbbf-47c8-b852-1d77a86b8211 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:56.450912 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ee01edb4-fbbf-47c8-b852-1d77a86b8211 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1747 microversion: 2.20 time: 0.307468 Jan 24 22:30:56.453708 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 303/629] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:56 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1747 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:56.459341 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-f6a1908d-37f3-42a5-8574-b486591e8e5c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1568 microversion: 2.1 time: 0.305128 Jan 24 22:30:56.460702 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 327/630] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:56 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:56.469711 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-f2385adf-a89c-4ac0-b8a5-ccf734fc17b4 req-21631095-8451-4aa8-bb5b-be466d5021c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5995cfc4-026f-45ae-a918-0bc8f1bdc025", "name": "network-vif-unplugged", "status": "completed", "tag": "987c8810-0969-4e25-bb03-7993afce108d"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:56.475140 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:30:56.475140 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:30:56.482078 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-f2385adf-a89c-4ac0-b8a5-ccf734fc17b4 req-21631095-8451-4aa8-bb5b-be466d5021c0 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:56.482515 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-f2385adf-a89c-4ac0-b8a5-ccf734fc17b4 req-21631095-8451-4aa8-bb5b-be466d5021c0 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:56.496063 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.compute.server_external_events [req-f2385adf-a89c-4ac0-b8a5-ccf734fc17b4 req-21631095-8451-4aa8-bb5b-be466d5021c0 service nova] Unable to find a host for instance 5995cfc4-026f-45ae-a918-0bc8f1bdc025. Dropping event network-vif-unplugged {{(pid=116466) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 24 22:30:56.496936 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-f2385adf-a89c-4ac0-b8a5-ccf734fc17b4 req-21631095-8451-4aa8-bb5b-be466d5021c0 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042049 Jan 24 22:30:56.497703 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 304/631] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 24 22:30:56.772830 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-d9116f09-a92b-4556-9a86-14443112f1bf tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:56.773469 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-d9116f09-a92b-4556-9a86-14443112f1bf tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:56.779230 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d9116f09-a92b-4556-9a86-14443112f1bf tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:56.779688 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d9116f09-a92b-4556-9a86-14443112f1bf tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:56.780455 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d9116f09-a92b-4556-9a86-14443112f1bf tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:56.780885 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d9116f09-a92b-4556-9a86-14443112f1bf tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:56.931445 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-d9116f09-a92b-4556-9a86-14443112f1bf tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:56.939103 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-d9116f09-a92b-4556-9a86-14443112f1bf tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1318 microversion: 2.1 time: 0.170015 Jan 24 22:30:56.939736 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 328/632] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:56 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:57.470473 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-62ccc293-39c1-4d4f-8c62-6eefce6d7d5e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:57.470866 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-62ccc293-39c1-4d4f-8c62-6eefce6d7d5e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:57.477951 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-62ccc293-39c1-4d4f-8c62-6eefce6d7d5e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:57.478461 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-62ccc293-39c1-4d4f-8c62-6eefce6d7d5e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:57.479146 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-62ccc293-39c1-4d4f-8c62-6eefce6d7d5e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:57.479568 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-62ccc293-39c1-4d4f-8c62-6eefce6d7d5e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:57.480259 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-01452c9c-cbb0-4cfb-b7b3-8961280b248e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:57.480917 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-01452c9c-cbb0-4cfb-b7b3-8961280b248e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:57.490685 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-01452c9c-cbb0-4cfb-b7b3-8961280b248e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:57.491132 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-01452c9c-cbb0-4cfb-b7b3-8961280b248e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:57.491906 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-01452c9c-cbb0-4cfb-b7b3-8961280b248e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:57.492452 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-01452c9c-cbb0-4cfb-b7b3-8961280b248e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:57.689951 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-01452c9c-cbb0-4cfb-b7b3-8961280b248e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:57.690353 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-62ccc293-39c1-4d4f-8c62-6eefce6d7d5e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:57.701744 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-01452c9c-cbb0-4cfb-b7b3-8961280b248e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1568 microversion: 2.1 time: 0.225878 Jan 24 22:30:57.702469 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 329/633] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:57 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:57.702947 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-62ccc293-39c1-4d4f-8c62-6eefce6d7d5e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:57.704807 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-62ccc293-39c1-4d4f-8c62-6eefce6d7d5e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:57.706304 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-62ccc293-39c1-4d4f-8c62-6eefce6d7d5e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1749 microversion: 2.20 time: 0.239585 Jan 24 22:30:57.707041 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 305/634] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:57 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1749 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:57.956521 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6df53fad-7777-4416-b362-5e646932616a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:57.957261 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6df53fad-7777-4416-b362-5e646932616a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:57.963494 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6df53fad-7777-4416-b362-5e646932616a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:57.963948 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6df53fad-7777-4416-b362-5e646932616a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:57.964764 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6df53fad-7777-4416-b362-5e646932616a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:57.965396 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6df53fad-7777-4416-b362-5e646932616a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:58.105599 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6df53fad-7777-4416-b362-5e646932616a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:58.113511 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6df53fad-7777-4416-b362-5e646932616a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1318 microversion: 2.1 time: 0.161309 Jan 24 22:30:58.114175 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 330/635] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:57 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:30:58.719966 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e7417926-6a6b-48eb-98d2-30e1d5050b47 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:58.720597 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e7417926-6a6b-48eb-98d2-30e1d5050b47 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:58.725628 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-47fb3d97-6590-4ef9-8a84-80d84b99b65a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:58.726228 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-47fb3d97-6590-4ef9-8a84-80d84b99b65a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:58.727786 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e7417926-6a6b-48eb-98d2-30e1d5050b47 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:58.728252 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e7417926-6a6b-48eb-98d2-30e1d5050b47 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:58.729210 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e7417926-6a6b-48eb-98d2-30e1d5050b47 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:58.729647 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e7417926-6a6b-48eb-98d2-30e1d5050b47 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:58.733035 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-47fb3d97-6590-4ef9-8a84-80d84b99b65a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:58.733492 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-47fb3d97-6590-4ef9-8a84-80d84b99b65a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:58.734318 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-47fb3d97-6590-4ef9-8a84-80d84b99b65a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:58.734749 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-47fb3d97-6590-4ef9-8a84-80d84b99b65a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:58.943573 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e7417926-6a6b-48eb-98d2-30e1d5050b47 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:58.947964 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-47fb3d97-6590-4ef9-8a84-80d84b99b65a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:58.951745 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e7417926-6a6b-48eb-98d2-30e1d5050b47 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1548 microversion: 2.1 time: 0.235665 Jan 24 22:30:58.952578 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 306/636] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:58 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1548 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:58.956694 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-47fb3d97-6590-4ef9-8a84-80d84b99b65a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:58.958232 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-47fb3d97-6590-4ef9-8a84-80d84b99b65a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:58.959400 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-47fb3d97-6590-4ef9-8a84-80d84b99b65a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.237465 Jan 24 22:30:58.959950 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 331/637] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:58 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:30:58.974805 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2a06b79b-3b4c-476f-a0ad-34d7bb7964c3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:58.975259 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2a06b79b-3b4c-476f-a0ad-34d7bb7964c3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:58.981391 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2a06b79b-3b4c-476f-a0ad-34d7bb7964c3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:58.981853 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2a06b79b-3b4c-476f-a0ad-34d7bb7964c3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:58.982638 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2a06b79b-3b4c-476f-a0ad-34d7bb7964c3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:58.983063 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2a06b79b-3b4c-476f-a0ad-34d7bb7964c3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:59.063306 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-2a06b79b-3b4c-476f-a0ad-34d7bb7964c3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] HTTP exception thrown: Cannot 'detach_volume' instance a871432f-36c3-495a-8269-9de0a0e45315 while it is in vm_state rescued Jan 24 22:30:59.064018 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2a06b79b-3b4c-476f-a0ad-34d7bb7964c3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Returning 409 to user: Cannot 'detach_volume' instance a871432f-36c3-495a-8269-9de0a0e45315 while it is in vm_state rescued {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:30:59.064835 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2a06b79b-3b4c-476f-a0ad-34d7bb7964c3 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "DELETE /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/os-volume_attachments/d40d2103-9569-4741-b5d6-1bcce25a906d" status: 409 len: 152 microversion: 2.1 time: 0.093905 Jan 24 22:30:59.065423 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 307/638] 10.222.0.84 () {58 vars in 1415 bytes} [Mon Jan 24 22:30:58 2022] DELETE /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/os-volume_attachments/d40d2103-9569-4741-b5d6-1bcce25a906d => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 24 22:30:59.074931 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-83ea05ca-5d81-4873-8198-e6e817b2d281 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:30:59.075464 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-83ea05ca-5d81-4873-8198-e6e817b2d281 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:59.082485 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-83ea05ca-5d81-4873-8198-e6e817b2d281 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:59.082926 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-83ea05ca-5d81-4873-8198-e6e817b2d281 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:59.083692 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-83ea05ca-5d81-4873-8198-e6e817b2d281 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:59.084152 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-83ea05ca-5d81-4873-8198-e6e817b2d281 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:59.130882 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ad2bb4ec-c64e-4754-a3c1-f7b972051c4a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:59.131494 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ad2bb4ec-c64e-4754-a3c1-f7b972051c4a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:59.138777 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ad2bb4ec-c64e-4754-a3c1-f7b972051c4a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:59.139437 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ad2bb4ec-c64e-4754-a3c1-f7b972051c4a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:59.140470 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ad2bb4ec-c64e-4754-a3c1-f7b972051c4a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:59.141406 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ad2bb4ec-c64e-4754-a3c1-f7b972051c4a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:59.156432 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-83ea05ca-5d81-4873-8198-e6e817b2d281 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "POST /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/action" status: 202 len: 0 microversion: 2.1 time: 0.085350 Jan 24 22:30:59.160122 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 332/639] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:30:59 2022] POST /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:30:59.175844 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2815aec4-e20c-4727-a9bb-b2548f0cf49c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:59.176535 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2815aec4-e20c-4727-a9bb-b2548f0cf49c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:59.183744 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2815aec4-e20c-4727-a9bb-b2548f0cf49c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:59.184217 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2815aec4-e20c-4727-a9bb-b2548f0cf49c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:59.185253 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2815aec4-e20c-4727-a9bb-b2548f0cf49c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:59.185597 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2815aec4-e20c-4727-a9bb-b2548f0cf49c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:59.323089 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ad2bb4ec-c64e-4754-a3c1-f7b972051c4a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:59.331456 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ad2bb4ec-c64e-4754-a3c1-f7b972051c4a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1318 microversion: 2.1 time: 0.204630 Jan 24 22:30:59.332130 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 308/640] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:59 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:30:59.380121 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2815aec4-e20c-4727-a9bb-b2548f0cf49c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:30:59.388448 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2815aec4-e20c-4727-a9bb-b2548f0cf49c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1556 microversion: 2.1 time: 0.222094 Jan 24 22:30:59.393195 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 333/641] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:30:59 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1556 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:30:59.981908 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a22d7bed-6043-4890-8965-50ae418d587e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:30:59.982808 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a22d7bed-6043-4890-8965-50ae418d587e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:30:59.994344 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a22d7bed-6043-4890-8965-50ae418d587e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:59.995085 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a22d7bed-6043-4890-8965-50ae418d587e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:30:59.996396 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a22d7bed-6043-4890-8965-50ae418d587e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:30:59.997185 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a22d7bed-6043-4890-8965-50ae418d587e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:00.132394 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a22d7bed-6043-4890-8965-50ae418d587e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:00.142178 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a22d7bed-6043-4890-8965-50ae418d587e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:00.143684 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a22d7bed-6043-4890-8965-50ae418d587e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:00.144841 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a22d7bed-6043-4890-8965-50ae418d587e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.169539 Jan 24 22:31:00.145428 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 309/642] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:30:59 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:00.347822 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1dc1d890-c254-4b3a-96f6-b7ab2e41c41a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:00.348399 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1dc1d890-c254-4b3a-96f6-b7ab2e41c41a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:00.355203 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1dc1d890-c254-4b3a-96f6-b7ab2e41c41a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:00.355652 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1dc1d890-c254-4b3a-96f6-b7ab2e41c41a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:00.357125 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1dc1d890-c254-4b3a-96f6-b7ab2e41c41a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:00.357125 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1dc1d890-c254-4b3a-96f6-b7ab2e41c41a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:00.405816 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-701bdd05-0435-4ef9-b2d6-fc12adea602f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:00.406703 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-701bdd05-0435-4ef9-b2d6-fc12adea602f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:00.413147 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-701bdd05-0435-4ef9-b2d6-fc12adea602f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:00.413703 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-701bdd05-0435-4ef9-b2d6-fc12adea602f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:00.414491 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-701bdd05-0435-4ef9-b2d6-fc12adea602f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:00.414944 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-701bdd05-0435-4ef9-b2d6-fc12adea602f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:00.517690 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1dc1d890-c254-4b3a-96f6-b7ab2e41c41a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:00.525115 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1dc1d890-c254-4b3a-96f6-b7ab2e41c41a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1318 microversion: 2.1 time: 0.181207 Jan 24 22:31:00.525934 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 334/643] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:00 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:00.577694 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-701bdd05-0435-4ef9-b2d6-fc12adea602f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:00.585699 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-701bdd05-0435-4ef9-b2d6-fc12adea602f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1556 microversion: 2.1 time: 0.183685 Jan 24 22:31:00.586267 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 310/644] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:00 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1556 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:01.166395 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-8b6e01c2-78fc-49b7-a477-fc800fac57c6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:01.167350 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-8b6e01c2-78fc-49b7-a477-fc800fac57c6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:01.175681 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8b6e01c2-78fc-49b7-a477-fc800fac57c6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:01.176160 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8b6e01c2-78fc-49b7-a477-fc800fac57c6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:01.177372 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8b6e01c2-78fc-49b7-a477-fc800fac57c6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:01.177372 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8b6e01c2-78fc-49b7-a477-fc800fac57c6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:01.318561 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-8b6e01c2-78fc-49b7-a477-fc800fac57c6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:01.327349 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-8b6e01c2-78fc-49b7-a477-fc800fac57c6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:01.329487 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-8b6e01c2-78fc-49b7-a477-fc800fac57c6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:01.330630 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-8b6e01c2-78fc-49b7-a477-fc800fac57c6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.170032 Jan 24 22:31:01.331493 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 335/645] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:01 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:01.358578 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-906f94e1-e282-4d29-ac60-1c2dd8396d38 req-5cb19ca8-fc37-461e-a766-5117c1212edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f960b38f-f542-4b02-972e-f0c17fe05d4c", "name": "network-vif-plugged", "status": "completed", "tag": "3b795779-9a59-417a-a073-f7d208152ddb"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:31:01.360147 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:31:01.360147 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:31:01.367901 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-906f94e1-e282-4d29-ac60-1c2dd8396d38 req-5cb19ca8-fc37-461e-a766-5117c1212edf service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:01.368343 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-906f94e1-e282-4d29-ac60-1c2dd8396d38 req-5cb19ca8-fc37-461e-a766-5117c1212edf service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:01.381802 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-906f94e1-e282-4d29-ac60-1c2dd8396d38 req-5cb19ca8-fc37-461e-a766-5117c1212edf service nova] Creating event network-vif-plugged:3b795779-9a59-417a-a073-f7d208152ddb for instance f960b38f-f542-4b02-972e-f0c17fe05d4c on hv-cinder-81322 Jan 24 22:31:01.387153 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-906f94e1-e282-4d29-ac60-1c2dd8396d38 req-5cb19ca8-fc37-461e-a766-5117c1212edf service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032175 Jan 24 22:31:01.387752 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 311/646] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:31:01.546313 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-41886ca4-ccab-4029-8934-b541ae5af311 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:01.547268 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-41886ca4-ccab-4029-8934-b541ae5af311 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:01.558392 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-41886ca4-ccab-4029-8934-b541ae5af311 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:01.559115 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-41886ca4-ccab-4029-8934-b541ae5af311 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:01.560376 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-41886ca4-ccab-4029-8934-b541ae5af311 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:01.561076 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-41886ca4-ccab-4029-8934-b541ae5af311 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:01.605267 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-85975136-95c1-4a19-8936-a75e8809ceb2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:01.605908 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-85975136-95c1-4a19-8936-a75e8809ceb2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:01.612435 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-85975136-95c1-4a19-8936-a75e8809ceb2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:01.612881 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-85975136-95c1-4a19-8936-a75e8809ceb2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:01.613706 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-85975136-95c1-4a19-8936-a75e8809ceb2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:01.614135 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-85975136-95c1-4a19-8936-a75e8809ceb2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:01.732766 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-41886ca4-ccab-4029-8934-b541ae5af311 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:01.740631 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-41886ca4-ccab-4029-8934-b541ae5af311 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1318 microversion: 2.1 time: 0.200588 Jan 24 22:31:01.741237 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 336/647] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:01 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:01.776048 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-85975136-95c1-4a19-8936-a75e8809ceb2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:01.784405 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-85975136-95c1-4a19-8936-a75e8809ceb2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1556 microversion: 2.1 time: 0.184340 Jan 24 22:31:01.784954 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 312/648] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:01 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1556 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:02.348900 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1e9af947-8f01-4f14-94e2-7842b67896b4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:02.349540 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1e9af947-8f01-4f14-94e2-7842b67896b4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:02.356588 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1e9af947-8f01-4f14-94e2-7842b67896b4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:02.356934 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1e9af947-8f01-4f14-94e2-7842b67896b4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:02.357987 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1e9af947-8f01-4f14-94e2-7842b67896b4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:02.358232 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1e9af947-8f01-4f14-94e2-7842b67896b4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:02.508482 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1e9af947-8f01-4f14-94e2-7842b67896b4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:02.517658 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1e9af947-8f01-4f14-94e2-7842b67896b4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:02.519489 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1e9af947-8f01-4f14-94e2-7842b67896b4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:02.520764 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1e9af947-8f01-4f14-94e2-7842b67896b4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.175777 Jan 24 22:31:02.533653 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 337/649] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:02 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:02.757484 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-19fb3b75-7806-4c2b-98fc-7367945c7e38 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:02.758088 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-19fb3b75-7806-4c2b-98fc-7367945c7e38 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:02.764805 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19fb3b75-7806-4c2b-98fc-7367945c7e38 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:02.765285 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19fb3b75-7806-4c2b-98fc-7367945c7e38 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:02.766123 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19fb3b75-7806-4c2b-98fc-7367945c7e38 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:02.766547 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19fb3b75-7806-4c2b-98fc-7367945c7e38 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:02.803047 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-07da6595-effa-46ef-b110-f458198d5a38 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:02.804770 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-07da6595-effa-46ef-b110-f458198d5a38 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:02.822761 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-07da6595-effa-46ef-b110-f458198d5a38 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:02.823242 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-07da6595-effa-46ef-b110-f458198d5a38 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:02.823993 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-07da6595-effa-46ef-b110-f458198d5a38 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:02.824745 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-07da6595-effa-46ef-b110-f458198d5a38 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:02.927706 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-19fb3b75-7806-4c2b-98fc-7367945c7e38 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:02.941589 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-19fb3b75-7806-4c2b-98fc-7367945c7e38 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1318 microversion: 2.1 time: 0.187715 Jan 24 22:31:02.942655 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 313/650] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:02 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:02.999205 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-07da6595-effa-46ef-b110-f458198d5a38 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:03.007277 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-07da6595-effa-46ef-b110-f458198d5a38 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1556 microversion: 2.1 time: 0.208881 Jan 24 22:31:03.007955 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 338/651] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:02 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1556 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:03.541339 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-0ef9ea92-cfb9-4a63-a4dc-0ca9c18a70ae tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:03.542367 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-0ef9ea92-cfb9-4a63-a4dc-0ca9c18a70ae tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:03.548758 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0ef9ea92-cfb9-4a63-a4dc-0ca9c18a70ae tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:03.549386 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0ef9ea92-cfb9-4a63-a4dc-0ca9c18a70ae tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:03.550269 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0ef9ea92-cfb9-4a63-a4dc-0ca9c18a70ae tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:03.550926 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0ef9ea92-cfb9-4a63-a4dc-0ca9c18a70ae tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:03.686756 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-0ef9ea92-cfb9-4a63-a4dc-0ca9c18a70ae tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:03.695754 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-0ef9ea92-cfb9-4a63-a4dc-0ca9c18a70ae tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:03.697266 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-0ef9ea92-cfb9-4a63-a4dc-0ca9c18a70ae tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:03.698431 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-0ef9ea92-cfb9-4a63-a4dc-0ca9c18a70ae tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.161244 Jan 24 22:31:03.698989 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 314/652] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:03 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:03.958765 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-cc811b22-b220-4192-a882-c8f3a5102f88 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:03.959376 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-cc811b22-b220-4192-a882-c8f3a5102f88 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:03.966030 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cc811b22-b220-4192-a882-c8f3a5102f88 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:03.966526 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cc811b22-b220-4192-a882-c8f3a5102f88 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:03.967284 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cc811b22-b220-4192-a882-c8f3a5102f88 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:03.967913 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cc811b22-b220-4192-a882-c8f3a5102f88 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:04.024713 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-4c407d01-b804-4299-af4b-69562b5d106a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:04.026040 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-4c407d01-b804-4299-af4b-69562b5d106a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:04.034027 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4c407d01-b804-4299-af4b-69562b5d106a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:04.034712 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4c407d01-b804-4299-af4b-69562b5d106a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:04.035671 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4c407d01-b804-4299-af4b-69562b5d106a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:04.036258 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4c407d01-b804-4299-af4b-69562b5d106a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:04.171587 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-cc811b22-b220-4192-a882-c8f3a5102f88 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:04.181874 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-cc811b22-b220-4192-a882-c8f3a5102f88 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1318 microversion: 2.1 time: 0.226888 Jan 24 22:31:04.186108 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 339/653] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:03 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:04.241775 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-4c407d01-b804-4299-af4b-69562b5d106a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:04.249727 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-4c407d01-b804-4299-af4b-69562b5d106a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1556 microversion: 2.1 time: 0.229234 Jan 24 22:31:04.250364 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 315/654] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:04 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1556 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:04.717409 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-7aab05af-6872-4bb1-b015-6257bfd605d1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:04.718069 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-7aab05af-6872-4bb1-b015-6257bfd605d1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:04.724464 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7aab05af-6872-4bb1-b015-6257bfd605d1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:04.724905 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7aab05af-6872-4bb1-b015-6257bfd605d1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:04.725709 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7aab05af-6872-4bb1-b015-6257bfd605d1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:04.726352 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7aab05af-6872-4bb1-b015-6257bfd605d1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:04.869341 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7aab05af-6872-4bb1-b015-6257bfd605d1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:04.881493 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7aab05af-6872-4bb1-b015-6257bfd605d1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:04.883134 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7aab05af-6872-4bb1-b015-6257bfd605d1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:04.884301 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-7aab05af-6872-4bb1-b015-6257bfd605d1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.170683 Jan 24 22:31:04.896364 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 340/655] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:04 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:05.203649 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ddcf0162-ff25-4b6d-95fe-103a08a17dac tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:05.205104 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ddcf0162-ff25-4b6d-95fe-103a08a17dac tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:05.212027 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ddcf0162-ff25-4b6d-95fe-103a08a17dac tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:05.212476 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ddcf0162-ff25-4b6d-95fe-103a08a17dac tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:05.213311 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ddcf0162-ff25-4b6d-95fe-103a08a17dac tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:05.213745 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ddcf0162-ff25-4b6d-95fe-103a08a17dac tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:05.266830 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a00acd3a-5f6a-4046-8391-84f718628d66 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:05.267568 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a00acd3a-5f6a-4046-8391-84f718628d66 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:05.274075 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a00acd3a-5f6a-4046-8391-84f718628d66 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:05.274525 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a00acd3a-5f6a-4046-8391-84f718628d66 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:05.275308 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a00acd3a-5f6a-4046-8391-84f718628d66 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:05.275922 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a00acd3a-5f6a-4046-8391-84f718628d66 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:05.404131 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ddcf0162-ff25-4b6d-95fe-103a08a17dac tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:05.421252 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ddcf0162-ff25-4b6d-95fe-103a08a17dac tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1318 microversion: 2.1 time: 0.221971 Jan 24 22:31:05.421895 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 316/656] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:05 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:05.463690 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a00acd3a-5f6a-4046-8391-84f718628d66 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:05.472396 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a00acd3a-5f6a-4046-8391-84f718628d66 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1556 microversion: 2.1 time: 0.209285 Jan 24 22:31:05.473002 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 341/657] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:05 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1556 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:31:05.906437 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-68339a39-0d4a-458d-8029-cfd9b1381b6a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:05.907094 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-68339a39-0d4a-458d-8029-cfd9b1381b6a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:05.913674 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-68339a39-0d4a-458d-8029-cfd9b1381b6a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:05.914127 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-68339a39-0d4a-458d-8029-cfd9b1381b6a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:05.914970 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-68339a39-0d4a-458d-8029-cfd9b1381b6a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:05.915384 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-68339a39-0d4a-458d-8029-cfd9b1381b6a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:06.053722 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-68339a39-0d4a-458d-8029-cfd9b1381b6a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:06.062420 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-68339a39-0d4a-458d-8029-cfd9b1381b6a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:06.064081 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-68339a39-0d4a-458d-8029-cfd9b1381b6a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:06.065372 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-68339a39-0d4a-458d-8029-cfd9b1381b6a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.165221 Jan 24 22:31:06.066209 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 317/658] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:05 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:06.439086 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-50ed615f-781d-408d-8596-7a22612f59e1 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:06.439812 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-50ed615f-781d-408d-8596-7a22612f59e1 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:06.446253 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-50ed615f-781d-408d-8596-7a22612f59e1 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:06.446700 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-50ed615f-781d-408d-8596-7a22612f59e1 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:06.447476 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-50ed615f-781d-408d-8596-7a22612f59e1 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:06.447904 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-50ed615f-781d-408d-8596-7a22612f59e1 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:06.491084 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1949624b-6ef4-4859-b394-20b837aa4f70 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:06.492517 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-1949624b-6ef4-4859-b394-20b837aa4f70 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:06.504962 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1949624b-6ef4-4859-b394-20b837aa4f70 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:06.505823 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1949624b-6ef4-4859-b394-20b837aa4f70 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:06.507044 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1949624b-6ef4-4859-b394-20b837aa4f70 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:06.508139 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1949624b-6ef4-4859-b394-20b837aa4f70 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:06.646172 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-50ed615f-781d-408d-8596-7a22612f59e1 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:06.653718 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-50ed615f-781d-408d-8596-7a22612f59e1 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1318 microversion: 2.1 time: 0.218932 Jan 24 22:31:06.654361 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 342/659] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:06 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:06.706022 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-1949624b-6ef4-4859-b394-20b837aa4f70 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:06.715231 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-1949624b-6ef4-4859-b394-20b837aa4f70 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1556 microversion: 2.1 time: 0.229263 Jan 24 22:31:06.715814 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 318/660] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:06 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1556 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:07.083674 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-40e4fece-af22-4f3c-a136-a18ad5c6f6f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:07.084311 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-40e4fece-af22-4f3c-a136-a18ad5c6f6f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:07.090433 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-40e4fece-af22-4f3c-a136-a18ad5c6f6f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:07.091157 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-40e4fece-af22-4f3c-a136-a18ad5c6f6f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:07.092202 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-40e4fece-af22-4f3c-a136-a18ad5c6f6f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:07.092636 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-40e4fece-af22-4f3c-a136-a18ad5c6f6f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:07.230902 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-40e4fece-af22-4f3c-a136-a18ad5c6f6f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:07.241099 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-40e4fece-af22-4f3c-a136-a18ad5c6f6f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:07.242873 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-40e4fece-af22-4f3c-a136-a18ad5c6f6f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:07.244976 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-40e4fece-af22-4f3c-a136-a18ad5c6f6f8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.165020 Jan 24 22:31:07.245951 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 343/661] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:07 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:07.671010 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ac7fa4e3-5a32-453a-bc89-a86230c208da tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:07.672332 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ac7fa4e3-5a32-453a-bc89-a86230c208da tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:07.678937 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ac7fa4e3-5a32-453a-bc89-a86230c208da tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:07.679422 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ac7fa4e3-5a32-453a-bc89-a86230c208da tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:07.680215 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ac7fa4e3-5a32-453a-bc89-a86230c208da tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:07.680661 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ac7fa4e3-5a32-453a-bc89-a86230c208da tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:07.733663 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ea357a3a-7500-4c46-8da5-06b0360dea65 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:07.734309 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ea357a3a-7500-4c46-8da5-06b0360dea65 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:07.741396 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ea357a3a-7500-4c46-8da5-06b0360dea65 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:07.742972 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ea357a3a-7500-4c46-8da5-06b0360dea65 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:07.744110 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ea357a3a-7500-4c46-8da5-06b0360dea65 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:07.744735 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ea357a3a-7500-4c46-8da5-06b0360dea65 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:08.124165 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ea357a3a-7500-4c46-8da5-06b0360dea65 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:08.132918 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ea357a3a-7500-4c46-8da5-06b0360dea65 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1556 microversion: 2.1 time: 0.403017 Jan 24 22:31:08.133520 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 344/662] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:07 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1556 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:08.154439 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ac7fa4e3-5a32-453a-bc89-a86230c208da tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:08.163780 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ac7fa4e3-5a32-453a-bc89-a86230c208da tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1318 microversion: 2.1 time: 0.496382 Jan 24 22:31:08.164681 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 319/663] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:07 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:08.266458 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4a6332e1-ba54-49ad-80f3-569b503500e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:08.267722 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4a6332e1-ba54-49ad-80f3-569b503500e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:08.276899 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4a6332e1-ba54-49ad-80f3-569b503500e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:08.277581 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4a6332e1-ba54-49ad-80f3-569b503500e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:08.278500 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4a6332e1-ba54-49ad-80f3-569b503500e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:08.279033 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4a6332e1-ba54-49ad-80f3-569b503500e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:08.483386 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4a6332e1-ba54-49ad-80f3-569b503500e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:08.501482 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4a6332e1-ba54-49ad-80f3-569b503500e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:08.503310 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4a6332e1-ba54-49ad-80f3-569b503500e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:08.505026 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4a6332e1-ba54-49ad-80f3-569b503500e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.244955 Jan 24 22:31:08.506282 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 345/664] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:08 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:09.151840 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-af7f7597-25b0-4844-a9a6-cb6d1228d21f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:09.153327 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-af7f7597-25b0-4844-a9a6-cb6d1228d21f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:09.161230 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-af7f7597-25b0-4844-a9a6-cb6d1228d21f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:09.162044 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-af7f7597-25b0-4844-a9a6-cb6d1228d21f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:09.162928 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-af7f7597-25b0-4844-a9a6-cb6d1228d21f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:09.163642 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-af7f7597-25b0-4844-a9a6-cb6d1228d21f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:09.182247 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-be174817-59e5-4f41-9d2f-7613cd50badc tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:09.182247 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-be174817-59e5-4f41-9d2f-7613cd50badc tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:09.198526 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-be174817-59e5-4f41-9d2f-7613cd50badc tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:09.198975 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-be174817-59e5-4f41-9d2f-7613cd50badc tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:09.199771 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-be174817-59e5-4f41-9d2f-7613cd50badc tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:09.200197 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-be174817-59e5-4f41-9d2f-7613cd50badc tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:09.390882 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-af7f7597-25b0-4844-a9a6-cb6d1228d21f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:09.394908 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-be174817-59e5-4f41-9d2f-7613cd50badc tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:09.399854 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-af7f7597-25b0-4844-a9a6-cb6d1228d21f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1556 microversion: 2.1 time: 0.251659 Jan 24 22:31:09.400938 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 320/665] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:09 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1556 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:09.404899 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-be174817-59e5-4f41-9d2f-7613cd50badc tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1318 microversion: 2.1 time: 0.226195 Jan 24 22:31:09.414376 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 346/666] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:09 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:31:09.523445 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2adb953c-7038-4115-b3f9-9f7b457407e0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:09.524135 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2adb953c-7038-4115-b3f9-9f7b457407e0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:09.530648 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2adb953c-7038-4115-b3f9-9f7b457407e0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:09.531154 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2adb953c-7038-4115-b3f9-9f7b457407e0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:09.532877 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2adb953c-7038-4115-b3f9-9f7b457407e0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:09.533492 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2adb953c-7038-4115-b3f9-9f7b457407e0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:09.729419 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-2adb953c-7038-4115-b3f9-9f7b457407e0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:09.739561 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-2adb953c-7038-4115-b3f9-9f7b457407e0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:09.743491 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-2adb953c-7038-4115-b3f9-9f7b457407e0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:09.745470 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2adb953c-7038-4115-b3f9-9f7b457407e0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.225731 Jan 24 22:31:09.747141 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 321/667] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:09 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:10.030995 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-cf8ac024-955a-443f-8f94-8928147b0180 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:10.031535 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-cf8ac024-955a-443f-8f94-8928147b0180 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:10.041296 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cf8ac024-955a-443f-8f94-8928147b0180 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:10.042090 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cf8ac024-955a-443f-8f94-8928147b0180 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:10.045602 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cf8ac024-955a-443f-8f94-8928147b0180 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:10.046084 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cf8ac024-955a-443f-8f94-8928147b0180 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:10.127306 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-cf8ac024-955a-443f-8f94-8928147b0180 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lazy-loading 'services' on Instance uuid 3a250b35-2478-48ce-b61d-9eae8933d5fb {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:31:10.203265 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-cf8ac024-955a-443f-8f94-8928147b0180 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "DELETE /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/os-volume_attachments/b9683a6a-6aa0-4843-ae6b-7119e13d13ac" status: 202 len: 0 microversion: 2.1 time: 0.176325 Jan 24 22:31:10.207204 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 347/668] 10.222.0.84 () {58 vars in 1415 bytes} [Mon Jan 24 22:31:10 2022] DELETE /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/os-volume_attachments/b9683a6a-6aa0-4843-ae6b-7119e13d13ac => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:31:10.422231 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-fd7f450a-4912-4c6b-9a92-a13da1f54c64 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:10.423225 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-fd7f450a-4912-4c6b-9a92-a13da1f54c64 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:10.423374 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-5f2a2880-2bdd-4fc6-8eda-2d0d7bc08138 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:10.423943 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-5f2a2880-2bdd-4fc6-8eda-2d0d7bc08138 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:10.429874 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fd7f450a-4912-4c6b-9a92-a13da1f54c64 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:10.430322 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fd7f450a-4912-4c6b-9a92-a13da1f54c64 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:10.430631 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5f2a2880-2bdd-4fc6-8eda-2d0d7bc08138 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:10.431082 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5f2a2880-2bdd-4fc6-8eda-2d0d7bc08138 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:10.431225 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fd7f450a-4912-4c6b-9a92-a13da1f54c64 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:10.431499 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fd7f450a-4912-4c6b-9a92-a13da1f54c64 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:10.431851 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5f2a2880-2bdd-4fc6-8eda-2d0d7bc08138 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:10.432276 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5f2a2880-2bdd-4fc6-8eda-2d0d7bc08138 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:10.641008 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-fd7f450a-4912-4c6b-9a92-a13da1f54c64 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:10.645686 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-5f2a2880-2bdd-4fc6-8eda-2d0d7bc08138 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:10.648686 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-fd7f450a-4912-4c6b-9a92-a13da1f54c64 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1318 microversion: 2.1 time: 0.230613 Jan 24 22:31:10.654192 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-5f2a2880-2bdd-4fc6-8eda-2d0d7bc08138 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1556 microversion: 2.1 time: 0.236902 Jan 24 22:31:10.654876 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 322/669] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:10 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1556 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:10.657960 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 348/670] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:10 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:31:10.766189 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3a25cb39-4cf7-49a0-9e16-b1b9166780ab tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:10.766679 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3a25cb39-4cf7-49a0-9e16-b1b9166780ab tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:10.773596 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3a25cb39-4cf7-49a0-9e16-b1b9166780ab tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:10.774043 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3a25cb39-4cf7-49a0-9e16-b1b9166780ab tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:10.774833 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3a25cb39-4cf7-49a0-9e16-b1b9166780ab tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:10.775261 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3a25cb39-4cf7-49a0-9e16-b1b9166780ab tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:10.917398 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3a25cb39-4cf7-49a0-9e16-b1b9166780ab tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:10.928210 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3a25cb39-4cf7-49a0-9e16-b1b9166780ab tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:10.929873 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3a25cb39-4cf7-49a0-9e16-b1b9166780ab tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:10.931182 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3a25cb39-4cf7-49a0-9e16-b1b9166780ab tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.168988 Jan 24 22:31:10.940666 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 323/671] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:10 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:11.666924 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-63129188-ad41-48a9-af64-cabe8780eac6 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:11.667703 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-63129188-ad41-48a9-af64-cabe8780eac6 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:11.672843 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a20e8efc-d213-49e0-affe-432e4e13373e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:11.673490 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a20e8efc-d213-49e0-affe-432e4e13373e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:11.674777 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-63129188-ad41-48a9-af64-cabe8780eac6 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:11.675227 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-63129188-ad41-48a9-af64-cabe8780eac6 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:11.676034 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-63129188-ad41-48a9-af64-cabe8780eac6 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:11.676479 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-63129188-ad41-48a9-af64-cabe8780eac6 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:11.681599 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a20e8efc-d213-49e0-affe-432e4e13373e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:11.682047 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a20e8efc-d213-49e0-affe-432e4e13373e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:11.682831 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a20e8efc-d213-49e0-affe-432e4e13373e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:11.683265 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a20e8efc-d213-49e0-affe-432e4e13373e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:11.871195 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-63129188-ad41-48a9-af64-cabe8780eac6 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:11.874421 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a20e8efc-d213-49e0-affe-432e4e13373e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:11.878956 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-63129188-ad41-48a9-af64-cabe8780eac6 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1318 microversion: 2.1 time: 0.216609 Jan 24 22:31:11.879524 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 349/672] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:11 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:11.883892 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a20e8efc-d213-49e0-affe-432e4e13373e tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1556 microversion: 2.1 time: 0.216437 Jan 24 22:31:11.884580 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 324/673] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:11 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1556 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:31:11.953468 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-dffe1504-8d85-45f7-9e01-1500a2af04c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:11.955170 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-dffe1504-8d85-45f7-9e01-1500a2af04c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:11.966011 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dffe1504-8d85-45f7-9e01-1500a2af04c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:11.966748 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dffe1504-8d85-45f7-9e01-1500a2af04c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:11.968004 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dffe1504-8d85-45f7-9e01-1500a2af04c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:11.969096 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dffe1504-8d85-45f7-9e01-1500a2af04c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:12.116232 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-dffe1504-8d85-45f7-9e01-1500a2af04c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:12.128090 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-dffe1504-8d85-45f7-9e01-1500a2af04c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:12.129615 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-dffe1504-8d85-45f7-9e01-1500a2af04c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:12.130770 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-dffe1504-8d85-45f7-9e01-1500a2af04c3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.183709 Jan 24 22:31:12.131515 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 350/674] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:11 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:12.902097 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c3332268-231b-4877-ab1b-aaa053a0a48b tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:12.903115 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c3332268-231b-4877-ab1b-aaa053a0a48b tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:12.907863 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-45ef5b5c-612e-44eb-9ae9-d0b3f96deb9b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:12.909095 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-45ef5b5c-612e-44eb-9ae9-d0b3f96deb9b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:12.913103 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c3332268-231b-4877-ab1b-aaa053a0a48b tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:12.913543 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c3332268-231b-4877-ab1b-aaa053a0a48b tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:12.914374 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c3332268-231b-4877-ab1b-aaa053a0a48b tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:12.915088 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c3332268-231b-4877-ab1b-aaa053a0a48b tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:12.915739 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-45ef5b5c-612e-44eb-9ae9-d0b3f96deb9b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:12.916195 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-45ef5b5c-612e-44eb-9ae9-d0b3f96deb9b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:12.917024 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-45ef5b5c-612e-44eb-9ae9-d0b3f96deb9b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:12.917484 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-45ef5b5c-612e-44eb-9ae9-d0b3f96deb9b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:13.137544 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c3332268-231b-4877-ab1b-aaa053a0a48b tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:13.145902 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c3332268-231b-4877-ab1b-aaa053a0a48b tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1506 microversion: 2.1 time: 0.251755 Jan 24 22:31:13.146473 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 325/675] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:12 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:13.150715 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-4590659a-c25f-46ae-a50f-db59ca84a429 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:13.151306 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-4590659a-c25f-46ae-a50f-db59ca84a429 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:13.152685 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-45ef5b5c-612e-44eb-9ae9-d0b3f96deb9b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:13.157930 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4590659a-c25f-46ae-a50f-db59ca84a429 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:13.158383 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4590659a-c25f-46ae-a50f-db59ca84a429 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:13.159172 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4590659a-c25f-46ae-a50f-db59ca84a429 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:13.159594 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4590659a-c25f-46ae-a50f-db59ca84a429 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:13.162244 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-45ef5b5c-612e-44eb-9ae9-d0b3f96deb9b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1556 microversion: 2.1 time: 0.259685 Jan 24 22:31:13.163074 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 351/676] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:12 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1556 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:13.294854 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-4590659a-c25f-46ae-a50f-db59ca84a429 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:13.303439 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-4590659a-c25f-46ae-a50f-db59ca84a429 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:13.305063 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-4590659a-c25f-46ae-a50f-db59ca84a429 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:13.306280 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-4590659a-c25f-46ae-a50f-db59ca84a429 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.158922 Jan 24 22:31:13.307097 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 326/677] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:13 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:13.455637 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-64ce1f46-aad1-4ee0-9819-252e41a6d1e7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:31:13.463754 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-64ce1f46-aad1-4ee0-9819-252e41a6d1e7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:13.464192 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-64ce1f46-aad1-4ee0-9819-252e41a6d1e7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:13.493785 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-64ce1f46-aad1-4ee0-9819-252e41a6d1e7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Going to try to stop instance {{(pid=116467) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 24 22:31:13.540332 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-64ce1f46-aad1-4ee0-9819-252e41a6d1e7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 202 len: 0 microversion: 2.1 time: 0.089841 Jan 24 22:31:13.541148 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 352/678] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:31:13 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:31:13.549469 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-5abd2371-5083-48e5-974d-f778547238a0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:13.550072 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-5abd2371-5083-48e5-974d-f778547238a0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:13.556416 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5abd2371-5083-48e5-974d-f778547238a0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:13.557017 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5abd2371-5083-48e5-974d-f778547238a0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:13.557771 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5abd2371-5083-48e5-974d-f778547238a0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:13.558248 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5abd2371-5083-48e5-974d-f778547238a0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:13.710231 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-5abd2371-5083-48e5-974d-f778547238a0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:13.717819 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-5abd2371-5083-48e5-974d-f778547238a0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1677 microversion: 2.1 time: 0.171993 Jan 24 22:31:13.718350 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 327/679] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:13 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:14.180811 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b27dd3d1-69f5-4c95-ac80-e96d5e6f6a18 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:14.181500 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b27dd3d1-69f5-4c95-ac80-e96d5e6f6a18 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:14.188210 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b27dd3d1-69f5-4c95-ac80-e96d5e6f6a18 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:14.188771 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b27dd3d1-69f5-4c95-ac80-e96d5e6f6a18 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:14.189647 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b27dd3d1-69f5-4c95-ac80-e96d5e6f6a18 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:14.190071 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b27dd3d1-69f5-4c95-ac80-e96d5e6f6a18 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:14.324859 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-82b46d00-8bcf-4038-80fb-3471efaaef1b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:14.326259 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-82b46d00-8bcf-4038-80fb-3471efaaef1b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:14.333015 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-82b46d00-8bcf-4038-80fb-3471efaaef1b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:14.333472 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-82b46d00-8bcf-4038-80fb-3471efaaef1b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:14.334088 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b27dd3d1-69f5-4c95-ac80-e96d5e6f6a18 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:14.334268 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-82b46d00-8bcf-4038-80fb-3471efaaef1b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:14.334652 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-82b46d00-8bcf-4038-80fb-3471efaaef1b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:14.342550 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b27dd3d1-69f5-4c95-ac80-e96d5e6f6a18 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1562 microversion: 2.1 time: 0.166563 Jan 24 22:31:14.343112 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 353/680] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:14 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:14.418051 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-eae13575-1dbf-4140-af27-4300b14ece0b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:14.418548 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-eae13575-1dbf-4140-af27-4300b14ece0b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:14.428963 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-eae13575-1dbf-4140-af27-4300b14ece0b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:14.428963 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-eae13575-1dbf-4140-af27-4300b14ece0b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:14.428963 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-eae13575-1dbf-4140-af27-4300b14ece0b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:14.428963 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-eae13575-1dbf-4140-af27-4300b14ece0b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:14.472959 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-82b46d00-8bcf-4038-80fb-3471efaaef1b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:14.481890 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-82b46d00-8bcf-4038-80fb-3471efaaef1b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:14.483521 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-82b46d00-8bcf-4038-80fb-3471efaaef1b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:14.484672 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-82b46d00-8bcf-4038-80fb-3471efaaef1b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.163567 Jan 24 22:31:14.485294 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 328/681] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:14 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:14.510293 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-eae13575-1dbf-4140-af27-4300b14ece0b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lazy-loading 'services' on Instance uuid a871432f-36c3-495a-8269-9de0a0e45315 {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:31:14.586191 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-eae13575-1dbf-4140-af27-4300b14ece0b tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "DELETE /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/os-volume_attachments/d40d2103-9569-4741-b5d6-1bcce25a906d" status: 202 len: 0 microversion: 2.1 time: 0.171687 Jan 24 22:31:14.586801 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 354/682] 10.222.0.84 () {58 vars in 1415 bytes} [Mon Jan 24 22:31:14 2022] DELETE /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/os-volume_attachments/d40d2103-9569-4741-b5d6-1bcce25a906d => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:31:14.597598 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-19c7a706-384f-40dd-9fef-9601ed9a8cb4 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:14.598690 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-19c7a706-384f-40dd-9fef-9601ed9a8cb4 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:14.606053 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19c7a706-384f-40dd-9fef-9601ed9a8cb4 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:14.606699 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19c7a706-384f-40dd-9fef-9601ed9a8cb4 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:14.607959 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19c7a706-384f-40dd-9fef-9601ed9a8cb4 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:14.608713 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19c7a706-384f-40dd-9fef-9601ed9a8cb4 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:14.658883 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-19c7a706-384f-40dd-9fef-9601ed9a8cb4 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067207 Jan 24 22:31:14.659670 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 329/683] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:31:14 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:31:14.737213 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a4bc959a-ecff-4960-b8dd-8033bd31d8cf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:14.737942 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a4bc959a-ecff-4960-b8dd-8033bd31d8cf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:14.744274 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a4bc959a-ecff-4960-b8dd-8033bd31d8cf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:14.744723 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a4bc959a-ecff-4960-b8dd-8033bd31d8cf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:14.745544 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a4bc959a-ecff-4960-b8dd-8033bd31d8cf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:14.746335 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a4bc959a-ecff-4960-b8dd-8033bd31d8cf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:14.890076 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a4bc959a-ecff-4960-b8dd-8033bd31d8cf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:14.899441 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a4bc959a-ecff-4960-b8dd-8033bd31d8cf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1677 microversion: 2.1 time: 0.167495 Jan 24 22:31:14.900282 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 355/684] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:14 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:15.508264 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-d4adb226-0fe3-4e14-8845-d6fd36d62ec7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:15.510890 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d4adb226-0fe3-4e14-8845-d6fd36d62ec7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:15.519901 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d4adb226-0fe3-4e14-8845-d6fd36d62ec7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:15.520343 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d4adb226-0fe3-4e14-8845-d6fd36d62ec7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:15.521142 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d4adb226-0fe3-4e14-8845-d6fd36d62ec7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:15.521568 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d4adb226-0fe3-4e14-8845-d6fd36d62ec7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:15.652077 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d4adb226-0fe3-4e14-8845-d6fd36d62ec7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:15.666417 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d4adb226-0fe3-4e14-8845-d6fd36d62ec7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:15.667911 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d4adb226-0fe3-4e14-8845-d6fd36d62ec7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:15.669095 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-d4adb226-0fe3-4e14-8845-d6fd36d62ec7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.167891 Jan 24 22:31:15.669772 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 330/685] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:15 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:15.671358 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e32005ec-a507-4f9f-84d7-3de26cfe3d4a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:15.672351 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e32005ec-a507-4f9f-84d7-3de26cfe3d4a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:15.679763 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e32005ec-a507-4f9f-84d7-3de26cfe3d4a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:15.680387 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e32005ec-a507-4f9f-84d7-3de26cfe3d4a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:15.681321 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e32005ec-a507-4f9f-84d7-3de26cfe3d4a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:15.681825 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e32005ec-a507-4f9f-84d7-3de26cfe3d4a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:15.714767 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e32005ec-a507-4f9f-84d7-3de26cfe3d4a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047223 Jan 24 22:31:15.715703 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 356/686] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:31:15 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:31:15.919609 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-9d3b2513-c18e-4fac-938d-935f10bcce53 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:15.920218 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-9d3b2513-c18e-4fac-938d-935f10bcce53 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:15.926639 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9d3b2513-c18e-4fac-938d-935f10bcce53 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:15.927084 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9d3b2513-c18e-4fac-938d-935f10bcce53 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:15.927852 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9d3b2513-c18e-4fac-938d-935f10bcce53 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:15.928287 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9d3b2513-c18e-4fac-938d-935f10bcce53 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:16.071101 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-9d3b2513-c18e-4fac-938d-935f10bcce53 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:16.082053 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-9d3b2513-c18e-4fac-938d-935f10bcce53 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1677 microversion: 2.1 time: 0.166185 Jan 24 22:31:16.082648 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 331/687] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:15 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:16.688890 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6f78a93f-4002-43da-b0ec-cae540c4032f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:16.689706 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6f78a93f-4002-43da-b0ec-cae540c4032f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:16.696859 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6f78a93f-4002-43da-b0ec-cae540c4032f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:16.697356 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6f78a93f-4002-43da-b0ec-cae540c4032f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:16.698176 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6f78a93f-4002-43da-b0ec-cae540c4032f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:16.698601 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6f78a93f-4002-43da-b0ec-cae540c4032f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:16.727665 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-09477c0d-0de1-47ff-82d6-7c6cf38e9a1d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:16.728564 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-09477c0d-0de1-47ff-82d6-7c6cf38e9a1d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:16.735167 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-09477c0d-0de1-47ff-82d6-7c6cf38e9a1d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:16.735616 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-09477c0d-0de1-47ff-82d6-7c6cf38e9a1d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:16.736424 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-09477c0d-0de1-47ff-82d6-7c6cf38e9a1d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:16.737076 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-09477c0d-0de1-47ff-82d6-7c6cf38e9a1d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:16.769911 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-09477c0d-0de1-47ff-82d6-7c6cf38e9a1d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046577 Jan 24 22:31:16.771163 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 332/688] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:31:16 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 22:31:16.843730 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6f78a93f-4002-43da-b0ec-cae540c4032f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:16.852355 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6f78a93f-4002-43da-b0ec-cae540c4032f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:16.853873 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6f78a93f-4002-43da-b0ec-cae540c4032f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:16.855026 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6f78a93f-4002-43da-b0ec-cae540c4032f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.170054 Jan 24 22:31:16.855588 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 357/689] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:16 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:17.104178 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8ac270f9-f224-4da8-9892-0f0e14c8f6ac tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:17.105337 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8ac270f9-f224-4da8-9892-0f0e14c8f6ac tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:17.115934 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8ac270f9-f224-4da8-9892-0f0e14c8f6ac tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:17.116799 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8ac270f9-f224-4da8-9892-0f0e14c8f6ac tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:17.118280 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8ac270f9-f224-4da8-9892-0f0e14c8f6ac tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:17.118939 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8ac270f9-f224-4da8-9892-0f0e14c8f6ac tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:17.271967 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-8ac270f9-f224-4da8-9892-0f0e14c8f6ac tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:17.279320 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8ac270f9-f224-4da8-9892-0f0e14c8f6ac tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1677 microversion: 2.1 time: 0.178894 Jan 24 22:31:17.279886 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 333/690] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:17 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:17.873522 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b4337631-de8e-490f-9647-34c02e0ea8c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:17.874136 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b4337631-de8e-490f-9647-34c02e0ea8c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:17.880959 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b4337631-de8e-490f-9647-34c02e0ea8c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:17.881496 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b4337631-de8e-490f-9647-34c02e0ea8c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:17.882360 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b4337631-de8e-490f-9647-34c02e0ea8c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:17.882909 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b4337631-de8e-490f-9647-34c02e0ea8c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:18.035147 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b4337631-de8e-490f-9647-34c02e0ea8c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:18.043991 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b4337631-de8e-490f-9647-34c02e0ea8c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:18.045531 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b4337631-de8e-490f-9647-34c02e0ea8c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:18.046690 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b4337631-de8e-490f-9647-34c02e0ea8c7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.176960 Jan 24 22:31:18.047241 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 358/691] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:17 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:18.295686 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6c142337-cc89-40e8-9a66-8290a2c19779 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:18.296292 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6c142337-cc89-40e8-9a66-8290a2c19779 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:18.308601 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6c142337-cc89-40e8-9a66-8290a2c19779 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:18.309203 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6c142337-cc89-40e8-9a66-8290a2c19779 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:18.310010 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6c142337-cc89-40e8-9a66-8290a2c19779 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:18.310442 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6c142337-cc89-40e8-9a66-8290a2c19779 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:18.474105 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-6c142337-cc89-40e8-9a66-8290a2c19779 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:18.483904 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6c142337-cc89-40e8-9a66-8290a2c19779 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1677 microversion: 2.1 time: 0.191816 Jan 24 22:31:18.484644 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 334/692] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:18 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:19.069134 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-663ff655-ef86-491d-b802-48dc0a81582a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:19.069804 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-663ff655-ef86-491d-b802-48dc0a81582a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:19.078875 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-663ff655-ef86-491d-b802-48dc0a81582a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:19.079370 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-663ff655-ef86-491d-b802-48dc0a81582a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:19.080152 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-663ff655-ef86-491d-b802-48dc0a81582a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:19.080582 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-663ff655-ef86-491d-b802-48dc0a81582a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:19.225622 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-663ff655-ef86-491d-b802-48dc0a81582a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:19.234144 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-663ff655-ef86-491d-b802-48dc0a81582a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:19.235621 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-663ff655-ef86-491d-b802-48dc0a81582a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:19.236769 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-663ff655-ef86-491d-b802-48dc0a81582a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.174230 Jan 24 22:31:19.237355 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 359/693] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:19 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:19.502457 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-38068da0-b396-4a19-ada6-2b57363248f3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:19.503136 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-38068da0-b396-4a19-ada6-2b57363248f3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:19.512235 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-38068da0-b396-4a19-ada6-2b57363248f3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:19.512235 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-38068da0-b396-4a19-ada6-2b57363248f3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:19.512235 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-38068da0-b396-4a19-ada6-2b57363248f3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:19.512635 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-38068da0-b396-4a19-ada6-2b57363248f3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:19.655576 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-38068da0-b396-4a19-ada6-2b57363248f3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:19.663741 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-38068da0-b396-4a19-ada6-2b57363248f3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1677 microversion: 2.1 time: 0.165144 Jan 24 22:31:19.664328 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 335/694] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:19 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:20.255276 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2004da59-39f4-45fb-ba1d-0edc8d71c419 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:20.255931 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2004da59-39f4-45fb-ba1d-0edc8d71c419 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:20.263142 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2004da59-39f4-45fb-ba1d-0edc8d71c419 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:20.263595 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2004da59-39f4-45fb-ba1d-0edc8d71c419 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:20.264371 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2004da59-39f4-45fb-ba1d-0edc8d71c419 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:20.264804 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2004da59-39f4-45fb-ba1d-0edc8d71c419 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:20.403018 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2004da59-39f4-45fb-ba1d-0edc8d71c419 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:20.411799 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2004da59-39f4-45fb-ba1d-0edc8d71c419 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:20.413309 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2004da59-39f4-45fb-ba1d-0edc8d71c419 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:20.414570 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2004da59-39f4-45fb-ba1d-0edc8d71c419 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.163635 Jan 24 22:31:20.415284 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 360/695] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:20 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:20.685396 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-85c5248e-eee2-42bc-8ca0-0bd56569a209 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:20.686046 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-85c5248e-eee2-42bc-8ca0-0bd56569a209 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:20.692765 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-85c5248e-eee2-42bc-8ca0-0bd56569a209 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:20.693239 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-85c5248e-eee2-42bc-8ca0-0bd56569a209 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:20.694007 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-85c5248e-eee2-42bc-8ca0-0bd56569a209 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:20.694432 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-85c5248e-eee2-42bc-8ca0-0bd56569a209 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:20.842188 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-85c5248e-eee2-42bc-8ca0-0bd56569a209 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:20.852206 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-85c5248e-eee2-42bc-8ca0-0bd56569a209 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1677 microversion: 2.1 time: 0.170478 Jan 24 22:31:20.853048 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 336/696] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:20 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:21.206707 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c0d293a1-bd91-48a5-9cc6-0e60a577c509 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:21.207421 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c0d293a1-bd91-48a5-9cc6-0e60a577c509 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:21.216891 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c0d293a1-bd91-48a5-9cc6-0e60a577c509 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:21.217361 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c0d293a1-bd91-48a5-9cc6-0e60a577c509 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:21.218405 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c0d293a1-bd91-48a5-9cc6-0e60a577c509 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:21.218916 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c0d293a1-bd91-48a5-9cc6-0e60a577c509 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:21.250582 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c0d293a1-bd91-48a5-9cc6-0e60a577c509 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Going to try to terminate instance {{(pid=116467) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:31:21.347604 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c0d293a1-bd91-48a5-9cc6-0e60a577c509 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "DELETE /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 204 len: 0 microversion: 2.1 time: 0.145351 Jan 24 22:31:21.349433 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 361/697] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:31:21 2022] DELETE /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:31:21.360429 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7b12e0e1-8587-4c20-8a4c-0dd7590dd85f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:21.361607 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7b12e0e1-8587-4c20-8a4c-0dd7590dd85f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:21.370769 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7b12e0e1-8587-4c20-8a4c-0dd7590dd85f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:21.371541 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7b12e0e1-8587-4c20-8a4c-0dd7590dd85f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:21.372863 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7b12e0e1-8587-4c20-8a4c-0dd7590dd85f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:21.373623 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7b12e0e1-8587-4c20-8a4c-0dd7590dd85f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:21.433727 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-02d6d092-50eb-4798-b3e8-5fb0354f0fc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:21.434408 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-02d6d092-50eb-4798-b3e8-5fb0354f0fc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:21.440425 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-02d6d092-50eb-4798-b3e8-5fb0354f0fc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:21.440870 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-02d6d092-50eb-4798-b3e8-5fb0354f0fc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:21.441698 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-02d6d092-50eb-4798-b3e8-5fb0354f0fc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:21.442086 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-02d6d092-50eb-4798-b3e8-5fb0354f0fc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:21.536477 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7b12e0e1-8587-4c20-8a4c-0dd7590dd85f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:21.544410 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7b12e0e1-8587-4c20-8a4c-0dd7590dd85f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1508 microversion: 2.1 time: 0.190585 Jan 24 22:31:21.545004 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 337/698] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:21 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:21.598585 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-02d6d092-50eb-4798-b3e8-5fb0354f0fc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:21.607482 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-02d6d092-50eb-4798-b3e8-5fb0354f0fc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:21.608944 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-02d6d092-50eb-4798-b3e8-5fb0354f0fc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:21.610127 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-02d6d092-50eb-4798-b3e8-5fb0354f0fc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.180609 Jan 24 22:31:21.610682 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 362/699] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:21 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:21.872020 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1cc5ec8b-d479-4c53-b121-31c7bc2f9796 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:21.872639 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-1cc5ec8b-d479-4c53-b121-31c7bc2f9796 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:21.880435 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1cc5ec8b-d479-4c53-b121-31c7bc2f9796 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:21.880965 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1cc5ec8b-d479-4c53-b121-31c7bc2f9796 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:21.881913 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1cc5ec8b-d479-4c53-b121-31c7bc2f9796 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:21.882425 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1cc5ec8b-d479-4c53-b121-31c7bc2f9796 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:22.024891 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-1cc5ec8b-d479-4c53-b121-31c7bc2f9796 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:22.032735 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-1cc5ec8b-d479-4c53-b121-31c7bc2f9796 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1677 microversion: 2.1 time: 0.166090 Jan 24 22:31:22.033313 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 338/700] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:21 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:22.566303 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2f175c77-0a6a-4034-9f39-95bfc26dfd43 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:22.567309 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2f175c77-0a6a-4034-9f39-95bfc26dfd43 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:22.578295 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2f175c77-0a6a-4034-9f39-95bfc26dfd43 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:22.579040 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2f175c77-0a6a-4034-9f39-95bfc26dfd43 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:22.580316 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2f175c77-0a6a-4034-9f39-95bfc26dfd43 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:22.581062 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2f175c77-0a6a-4034-9f39-95bfc26dfd43 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:22.628411 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-abf4fc57-0037-4dca-8a6e-40b91e48661d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:22.628893 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-abf4fc57-0037-4dca-8a6e-40b91e48661d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:22.634971 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-abf4fc57-0037-4dca-8a6e-40b91e48661d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:22.635747 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-abf4fc57-0037-4dca-8a6e-40b91e48661d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:22.636882 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-abf4fc57-0037-4dca-8a6e-40b91e48661d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:22.637397 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-abf4fc57-0037-4dca-8a6e-40b91e48661d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:22.752373 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2f175c77-0a6a-4034-9f39-95bfc26dfd43 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:22.759754 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2f175c77-0a6a-4034-9f39-95bfc26dfd43 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1508 microversion: 2.1 time: 0.199757 Jan 24 22:31:22.760377 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 363/701] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:22 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1508 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:22.796448 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-abf4fc57-0037-4dca-8a6e-40b91e48661d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:22.808381 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-abf4fc57-0037-4dca-8a6e-40b91e48661d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:22.809900 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-abf4fc57-0037-4dca-8a6e-40b91e48661d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:22.811052 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-abf4fc57-0037-4dca-8a6e-40b91e48661d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.186512 Jan 24 22:31:22.811604 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 339/702] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:22 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:31:23.053975 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-eda66fe4-e0ff-408b-9364-fb1f627f9780 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:23.055001 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-eda66fe4-e0ff-408b-9364-fb1f627f9780 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:23.065898 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-eda66fe4-e0ff-408b-9364-fb1f627f9780 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:23.066672 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-eda66fe4-e0ff-408b-9364-fb1f627f9780 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:23.068172 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-eda66fe4-e0ff-408b-9364-fb1f627f9780 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:23.068645 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-eda66fe4-e0ff-408b-9364-fb1f627f9780 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:23.163973 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 22:31:23.164195 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: Mon Jan 24 22:31:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb (ip 10.222.0.84) !!! Jan 24 22:31:23.218626 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-eda66fe4-e0ff-408b-9364-fb1f627f9780 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:23.226212 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-eda66fe4-e0ff-408b-9364-fb1f627f9780 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1677 microversion: 2.1 time: 0.178562 Jan 24 22:31:23.226788 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 364/703] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:23 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:23.781313 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-bda64f5c-3fb8-4f6b-89a6-92c844db5325 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:23.782279 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-bda64f5c-3fb8-4f6b-89a6-92c844db5325 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:23.792630 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bda64f5c-3fb8-4f6b-89a6-92c844db5325 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:23.793113 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bda64f5c-3fb8-4f6b-89a6-92c844db5325 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:23.793882 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bda64f5c-3fb8-4f6b-89a6-92c844db5325 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:23.794309 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bda64f5c-3fb8-4f6b-89a6-92c844db5325 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:23.833486 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3b5b7be2-94f5-4af5-96a7-62982395aed4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:23.834410 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-3b5b7be2-94f5-4af5-96a7-62982395aed4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:23.842859 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3b5b7be2-94f5-4af5-96a7-62982395aed4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:23.843299 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3b5b7be2-94f5-4af5-96a7-62982395aed4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:23.844164 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3b5b7be2-94f5-4af5-96a7-62982395aed4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:23.844591 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3b5b7be2-94f5-4af5-96a7-62982395aed4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:23.962698 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-bda64f5c-3fb8-4f6b-89a6-92c844db5325 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:23.972296 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-bda64f5c-3fb8-4f6b-89a6-92c844db5325 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1508 microversion: 2.1 time: 0.197101 Jan 24 22:31:23.972925 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 340/704] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:23 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:24.023304 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3b5b7be2-94f5-4af5-96a7-62982395aed4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:24.032088 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3b5b7be2-94f5-4af5-96a7-62982395aed4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:24.033656 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3b5b7be2-94f5-4af5-96a7-62982395aed4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:24.034829 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-3b5b7be2-94f5-4af5-96a7-62982395aed4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.208264 Jan 24 22:31:24.035411 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 365/705] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:23 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:24.244120 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c303f0ea-936e-4d58-86a3-0e72ed80c8e2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:24.245415 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c303f0ea-936e-4d58-86a3-0e72ed80c8e2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:24.251632 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c303f0ea-936e-4d58-86a3-0e72ed80c8e2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:24.252140 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c303f0ea-936e-4d58-86a3-0e72ed80c8e2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:24.252924 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c303f0ea-936e-4d58-86a3-0e72ed80c8e2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:24.253380 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c303f0ea-936e-4d58-86a3-0e72ed80c8e2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:24.268128 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 22:31:24.268290 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: Mon Jan 24 22:31:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb (ip 10.222.0.84) !!! Jan 24 22:31:24.405626 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c303f0ea-936e-4d58-86a3-0e72ed80c8e2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:24.413176 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c303f0ea-936e-4d58-86a3-0e72ed80c8e2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1677 microversion: 2.1 time: 0.172816 Jan 24 22:31:24.416598 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 341/706] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:24 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:24.988971 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-d12b5699-5f5b-46c5-8e96-37990636fa1f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:24.989674 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-d12b5699-5f5b-46c5-8e96-37990636fa1f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:24.997040 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d12b5699-5f5b-46c5-8e96-37990636fa1f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:24.997523 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d12b5699-5f5b-46c5-8e96-37990636fa1f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:24.998502 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d12b5699-5f5b-46c5-8e96-37990636fa1f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:24.999262 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d12b5699-5f5b-46c5-8e96-37990636fa1f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:25.053985 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-13ca4648-3e62-494b-94f0-d59920812740 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:25.055230 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-13ca4648-3e62-494b-94f0-d59920812740 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:25.061430 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-13ca4648-3e62-494b-94f0-d59920812740 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:25.061880 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-13ca4648-3e62-494b-94f0-d59920812740 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:25.062667 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-13ca4648-3e62-494b-94f0-d59920812740 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:25.063103 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-13ca4648-3e62-494b-94f0-d59920812740 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:25.205319 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-d12b5699-5f5b-46c5-8e96-37990636fa1f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:25.216048 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-d12b5699-5f5b-46c5-8e96-37990636fa1f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1508 microversion: 2.1 time: 0.230623 Jan 24 22:31:25.216646 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 366/707] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:24 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:25.266662 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-13ca4648-3e62-494b-94f0-d59920812740 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:25.275081 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-13ca4648-3e62-494b-94f0-d59920812740 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:25.276666 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-13ca4648-3e62-494b-94f0-d59920812740 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:25.277841 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-13ca4648-3e62-494b-94f0-d59920812740 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.227682 Jan 24 22:31:25.278400 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 342/708] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:25 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:25.430621 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e86672ac-4940-422b-8b60-702d089b917c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:25.431246 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e86672ac-4940-422b-8b60-702d089b917c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:25.437931 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e86672ac-4940-422b-8b60-702d089b917c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:25.438383 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e86672ac-4940-422b-8b60-702d089b917c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:25.439149 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e86672ac-4940-422b-8b60-702d089b917c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:25.439575 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e86672ac-4940-422b-8b60-702d089b917c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:25.581767 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e86672ac-4940-422b-8b60-702d089b917c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:25.589613 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e86672ac-4940-422b-8b60-702d089b917c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1677 microversion: 2.1 time: 0.162693 Jan 24 22:31:25.590176 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 367/709] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:25 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:26.233530 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-85258af6-13cc-4e5b-8c31-f3b31a4de056 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:26.234094 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-85258af6-13cc-4e5b-8c31-f3b31a4de056 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:26.240739 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-85258af6-13cc-4e5b-8c31-f3b31a4de056 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:26.241301 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-85258af6-13cc-4e5b-8c31-f3b31a4de056 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:26.242089 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-85258af6-13cc-4e5b-8c31-f3b31a4de056 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:26.242524 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-85258af6-13cc-4e5b-8c31-f3b31a4de056 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:26.296016 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-059e42f7-0715-4e9d-b9ee-1918bf2d632f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:26.296651 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-059e42f7-0715-4e9d-b9ee-1918bf2d632f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:26.305699 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-059e42f7-0715-4e9d-b9ee-1918bf2d632f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:26.306144 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-059e42f7-0715-4e9d-b9ee-1918bf2d632f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:26.307131 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-059e42f7-0715-4e9d-b9ee-1918bf2d632f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:26.307699 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-059e42f7-0715-4e9d-b9ee-1918bf2d632f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:26.422069 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-85258af6-13cc-4e5b-8c31-f3b31a4de056 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:26.430325 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-85258af6-13cc-4e5b-8c31-f3b31a4de056 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1508 microversion: 2.1 time: 0.201718 Jan 24 22:31:26.430899 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 343/710] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:26 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:26.481298 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-059e42f7-0715-4e9d-b9ee-1918bf2d632f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:26.484599 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-9f02d427-a481-49ca-ab53-7c52b81a026d req-b07d7cc0-b6b9-4875-a07e-21700b00db5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5995cfc4-026f-45ae-a918-0bc8f1bdc025", "name": "network-vif-plugged", "status": "completed", "tag": "987c8810-0969-4e25-bb03-7993afce108d"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:31:26.486230 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:31:26.486230 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:31:26.492530 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-059e42f7-0715-4e9d-b9ee-1918bf2d632f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:26.493322 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-9f02d427-a481-49ca-ab53-7c52b81a026d req-b07d7cc0-b6b9-4875-a07e-21700b00db5f service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:26.493818 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-9f02d427-a481-49ca-ab53-7c52b81a026d req-b07d7cc0-b6b9-4875-a07e-21700b00db5f service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:26.496877 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-059e42f7-0715-4e9d-b9ee-1918bf2d632f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:26.499357 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-059e42f7-0715-4e9d-b9ee-1918bf2d632f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.207397 Jan 24 22:31:26.500129 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 368/711] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:26 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:31:26.507310 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-9f02d427-a481-49ca-ab53-7c52b81a026d req-b07d7cc0-b6b9-4875-a07e-21700b00db5f service nova] Creating event network-vif-plugged:987c8810-0969-4e25-bb03-7993afce108d for instance 5995cfc4-026f-45ae-a918-0bc8f1bdc025 on hv-cinder-81322 Jan 24 22:31:26.514735 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-9f02d427-a481-49ca-ab53-7c52b81a026d req-b07d7cc0-b6b9-4875-a07e-21700b00db5f service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033919 Jan 24 22:31:26.515603 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 344/712] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:31:26.607484 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-5f693656-3caf-41f1-b73d-af6d5c8ff64b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:26.608075 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-5f693656-3caf-41f1-b73d-af6d5c8ff64b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:26.614667 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5f693656-3caf-41f1-b73d-af6d5c8ff64b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:26.615049 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5f693656-3caf-41f1-b73d-af6d5c8ff64b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:26.615823 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5f693656-3caf-41f1-b73d-af6d5c8ff64b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:26.616261 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5f693656-3caf-41f1-b73d-af6d5c8ff64b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:26.760078 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5f693656-3caf-41f1-b73d-af6d5c8ff64b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:26.768668 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-5f693656-3caf-41f1-b73d-af6d5c8ff64b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1677 microversion: 2.1 time: 0.165239 Jan 24 22:31:26.769269 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 369/713] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:26 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:27.451391 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a479f057-f4c5-43c7-8c64-a444bb3834ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:27.452389 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a479f057-f4c5-43c7-8c64-a444bb3834ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:27.460677 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a479f057-f4c5-43c7-8c64-a444bb3834ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:27.461162 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a479f057-f4c5-43c7-8c64-a444bb3834ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:27.461960 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a479f057-f4c5-43c7-8c64-a444bb3834ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:27.466183 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a479f057-f4c5-43c7-8c64-a444bb3834ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:27.518757 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-7eef79aa-6dc5-40f7-bd2f-26ab214127e2 req-a708f215-3ebf-4830-92c6-e0bff067f55f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4044f2ed-7e33-45cf-9b1b-6447f372c243", "name": "network-vif-deleted", "tag": "80c7633d-9102-4911-954f-6788c2d7bbcc"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:31:27.520364 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:31:27.520364 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:31:27.537850 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-7eef79aa-6dc5-40f7-bd2f-26ab214127e2 req-a708f215-3ebf-4830-92c6-e0bff067f55f service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:27.538356 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-7eef79aa-6dc5-40f7-bd2f-26ab214127e2 req-a708f215-3ebf-4830-92c6-e0bff067f55f service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:27.562078 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-7eef79aa-6dc5-40f7-bd2f-26ab214127e2 req-a708f215-3ebf-4830-92c6-e0bff067f55f service nova] Creating event network-vif-deleted:80c7633d-9102-4911-954f-6788c2d7bbcc for instance 4044f2ed-7e33-45cf-9b1b-6447f372c243 on hv-cinder-81322 Jan 24 22:31:27.562285 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a479f057-f4c5-43c7-8c64-a444bb3834ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:27.567246 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-7eef79aa-6dc5-40f7-bd2f-26ab214127e2 req-a708f215-3ebf-4830-92c6-e0bff067f55f service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052328 Jan 24 22:31:27.567994 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 370/714] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:31:27.571468 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a479f057-f4c5-43c7-8c64-a444bb3834ac tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1466 microversion: 2.1 time: 0.126105 Jan 24 22:31:27.574376 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-d32210ce-0af1-4fbd-8752-f90c06f1654a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:27.575184 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-d32210ce-0af1-4fbd-8752-f90c06f1654a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:27.581175 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 345/715] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:27 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1466 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:27.581716 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d32210ce-0af1-4fbd-8752-f90c06f1654a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:27.582239 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d32210ce-0af1-4fbd-8752-f90c06f1654a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:27.583103 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d32210ce-0af1-4fbd-8752-f90c06f1654a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:27.583600 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d32210ce-0af1-4fbd-8752-f90c06f1654a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:27.723446 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-d32210ce-0af1-4fbd-8752-f90c06f1654a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:27.733818 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-d32210ce-0af1-4fbd-8752-f90c06f1654a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:27.735414 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-d32210ce-0af1-4fbd-8752-f90c06f1654a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:27.736601 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-d32210ce-0af1-4fbd-8752-f90c06f1654a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.167317 Jan 24 22:31:27.737206 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 371/716] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:27 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:27.786053 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-901a9bf6-ffbb-4681-b3de-49c86f2467b1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:27.786598 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-901a9bf6-ffbb-4681-b3de-49c86f2467b1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:27.792935 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-901a9bf6-ffbb-4681-b3de-49c86f2467b1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:27.793423 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-901a9bf6-ffbb-4681-b3de-49c86f2467b1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:27.794199 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-901a9bf6-ffbb-4681-b3de-49c86f2467b1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:27.794632 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-901a9bf6-ffbb-4681-b3de-49c86f2467b1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:27.938245 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-901a9bf6-ffbb-4681-b3de-49c86f2467b1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:27.945742 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-901a9bf6-ffbb-4681-b3de-49c86f2467b1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1677 microversion: 2.1 time: 0.163491 Jan 24 22:31:27.946309 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 346/717] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:27 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:28.588169 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6f4e45a5-c871-4368-8f67-bfc606baa7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:28.588714 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6f4e45a5-c871-4368-8f67-bfc606baa7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:28.595640 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6f4e45a5-c871-4368-8f67-bfc606baa7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:28.596082 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6f4e45a5-c871-4368-8f67-bfc606baa7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:28.596860 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6f4e45a5-c871-4368-8f67-bfc606baa7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:28.597284 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6f4e45a5-c871-4368-8f67-bfc606baa7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:28.630010 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6f4e45a5-c871-4368-8f67-bfc606baa7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:28.630412 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6f4e45a5-c871-4368-8f67-bfc606baa7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:28.630840 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-6f4e45a5-c871-4368-8f67-bfc606baa7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lazy-loading 'fault' on Instance uuid 4044f2ed-7e33-45cf-9b1b-6447f372c243 {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:31:28.677045 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6f4e45a5-c871-4368-8f67-bfc606baa7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:28.684372 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6f4e45a5-c871-4368-8f67-bfc606baa7b1 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 200 len: 1312 microversion: 2.1 time: 0.099934 Jan 24 22:31:28.685254 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 372/718] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:28 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:28.755328 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-d2446782-e704-46f9-9381-dadb0717bbb8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:28.756084 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d2446782-e704-46f9-9381-dadb0717bbb8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:28.763695 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d2446782-e704-46f9-9381-dadb0717bbb8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:28.764263 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d2446782-e704-46f9-9381-dadb0717bbb8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:28.765217 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d2446782-e704-46f9-9381-dadb0717bbb8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:28.765753 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d2446782-e704-46f9-9381-dadb0717bbb8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:28.947684 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d2446782-e704-46f9-9381-dadb0717bbb8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:28.957555 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d2446782-e704-46f9-9381-dadb0717bbb8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:28.960607 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d2446782-e704-46f9-9381-dadb0717bbb8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:28.965188 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-d2446782-e704-46f9-9381-dadb0717bbb8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1805 microversion: 2.20 time: 0.210737 Jan 24 22:31:28.965188 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 347/719] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:28 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1805 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:28.971801 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b0b05f36-3cff-4326-9413-4f76d437fbbd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:28.972491 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b0b05f36-3cff-4326-9413-4f76d437fbbd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:28.979421 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b0b05f36-3cff-4326-9413-4f76d437fbbd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:28.979899 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b0b05f36-3cff-4326-9413-4f76d437fbbd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:28.980917 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b0b05f36-3cff-4326-9413-4f76d437fbbd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:28.981556 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b0b05f36-3cff-4326-9413-4f76d437fbbd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:29.124157 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b0b05f36-3cff-4326-9413-4f76d437fbbd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:29.132113 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b0b05f36-3cff-4326-9413-4f76d437fbbd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1677 microversion: 2.1 time: 0.171794 Jan 24 22:31:29.144842 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 373/720] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:28 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:31:29.703211 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a5443c54-3815-4c9d-85db-3174339c336c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:29.703824 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a5443c54-3815-4c9d-85db-3174339c336c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: 4044f2ed-7e33-45cf-9b1b-6447f372c243] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:29.709926 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a5443c54-3815-4c9d-85db-3174339c336c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:29.710373 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a5443c54-3815-4c9d-85db-3174339c336c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:29.711152 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a5443c54-3815-4c9d-85db-3174339c336c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:29.711592 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a5443c54-3815-4c9d-85db-3174339c336c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:29.725725 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-a5443c54-3815-4c9d-85db-3174339c336c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] HTTP exception thrown: Instance 4044f2ed-7e33-45cf-9b1b-6447f372c243 could not be found. Jan 24 22:31:29.726311 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a5443c54-3815-4c9d-85db-3174339c336c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Returning 404 to user: Instance 4044f2ed-7e33-45cf-9b1b-6447f372c243 could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:31:29.727125 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a5443c54-3815-4c9d-85db-3174339c336c tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243" status: 404 len: 111 microversion: 2.1 time: 0.028418 Jan 24 22:31:29.727663 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 348/721] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:29 2022] GET /compute/v2.1/servers/4044f2ed-7e33-45cf-9b1b-6447f372c243 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:31:29.736516 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b53201ad-833c-4683-8108-c77f5755c926 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:29.737127 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b53201ad-833c-4683-8108-c77f5755c926 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:29.743853 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b53201ad-833c-4683-8108-c77f5755c926 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:29.744297 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b53201ad-833c-4683-8108-c77f5755c926 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:29.745093 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b53201ad-833c-4683-8108-c77f5755c926 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:29.745536 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b53201ad-833c-4683-8108-c77f5755c926 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:29.774262 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b53201ad-833c-4683-8108-c77f5755c926 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Going to try to terminate instance {{(pid=116467) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:31:29.862384 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b53201ad-833c-4683-8108-c77f5755c926 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "DELETE /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 204 len: 0 microversion: 2.1 time: 0.129345 Jan 24 22:31:29.863136 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 374/722] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:31:29 2022] DELETE /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:31:29.871698 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-0b081936-2eab-4c33-9353-a7e5ccf06a6a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:29.872361 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-0b081936-2eab-4c33-9353-a7e5ccf06a6a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:29.879157 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0b081936-2eab-4c33-9353-a7e5ccf06a6a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:29.879613 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0b081936-2eab-4c33-9353-a7e5ccf06a6a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:29.880404 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0b081936-2eab-4c33-9353-a7e5ccf06a6a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:29.880842 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0b081936-2eab-4c33-9353-a7e5ccf06a6a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:29.980551 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a4049398-81fc-45d5-b43d-36d9a9b0acb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:29.981344 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a4049398-81fc-45d5-b43d-36d9a9b0acb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:29.991665 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a4049398-81fc-45d5-b43d-36d9a9b0acb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:29.992203 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a4049398-81fc-45d5-b43d-36d9a9b0acb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:29.993087 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a4049398-81fc-45d5-b43d-36d9a9b0acb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:29.993602 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a4049398-81fc-45d5-b43d-36d9a9b0acb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:30.016946 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-0b081936-2eab-4c33-9353-a7e5ccf06a6a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:30.026086 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-0b081936-2eab-4c33-9353-a7e5ccf06a6a tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.157935 Jan 24 22:31:30.035629 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 349/723] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:29 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:30.144296 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a4049398-81fc-45d5-b43d-36d9a9b0acb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:30.152125 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ccaaf7fd-cae3-48cf-88ec-588c1283f3b5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:30.153023 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ccaaf7fd-cae3-48cf-88ec-588c1283f3b5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:30.153538 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a4049398-81fc-45d5-b43d-36d9a9b0acb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:30.155321 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a4049398-81fc-45d5-b43d-36d9a9b0acb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:30.156370 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a4049398-81fc-45d5-b43d-36d9a9b0acb1 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1792 microversion: 2.20 time: 0.180587 Jan 24 22:31:30.156924 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 375/724] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:31:29 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1792 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:31:30.159508 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ccaaf7fd-cae3-48cf-88ec-588c1283f3b5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:30.160035 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ccaaf7fd-cae3-48cf-88ec-588c1283f3b5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:30.160743 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ccaaf7fd-cae3-48cf-88ec-588c1283f3b5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:30.161221 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ccaaf7fd-cae3-48cf-88ec-588c1283f3b5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:30.308313 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ccaaf7fd-cae3-48cf-88ec-588c1283f3b5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:30.316281 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ccaaf7fd-cae3-48cf-88ec-588c1283f3b5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1654 microversion: 2.1 time: 0.168356 Jan 24 22:31:30.316899 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 350/725] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:30 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1654 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:30.332603 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-8a7f5428-5445-42ed-b295-6d60d38d57b9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:31:30.338833 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8a7f5428-5445-42ed-b295-6d60d38d57b9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:30.339281 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8a7f5428-5445-42ed-b295-6d60d38d57b9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:30.361550 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-8a7f5428-5445-42ed-b295-6d60d38d57b9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Going to try to start instance {{(pid=116467) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 24 22:31:30.414302 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-8a7f5428-5445-42ed-b295-6d60d38d57b9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action" status: 202 len: 0 microversion: 2.1 time: 0.084794 Jan 24 22:31:30.415508 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 376/726] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:31:30 2022] POST /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:31:30.425657 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-08332b7f-81bc-4823-a6da-5fe3bda44d06 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:30.426612 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-08332b7f-81bc-4823-a6da-5fe3bda44d06 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:30.432099 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-08332b7f-81bc-4823-a6da-5fe3bda44d06 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:30.432572 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-08332b7f-81bc-4823-a6da-5fe3bda44d06 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:30.433571 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-08332b7f-81bc-4823-a6da-5fe3bda44d06 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:30.434035 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-08332b7f-81bc-4823-a6da-5fe3bda44d06 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:30.573753 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-08332b7f-81bc-4823-a6da-5fe3bda44d06 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:30.582418 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-08332b7f-81bc-4823-a6da-5fe3bda44d06 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1663 microversion: 2.1 time: 0.161017 Jan 24 22:31:30.583176 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 351/727] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:30 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:31:31.044189 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-fa55b840-91f6-4e8a-b77e-3bdd8569d1a2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:31.044880 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-fa55b840-91f6-4e8a-b77e-3bdd8569d1a2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:31.051841 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fa55b840-91f6-4e8a-b77e-3bdd8569d1a2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:31.052307 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fa55b840-91f6-4e8a-b77e-3bdd8569d1a2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:31.053091 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fa55b840-91f6-4e8a-b77e-3bdd8569d1a2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:31.053528 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fa55b840-91f6-4e8a-b77e-3bdd8569d1a2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:31.212752 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-fa55b840-91f6-4e8a-b77e-3bdd8569d1a2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:31.223078 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-fa55b840-91f6-4e8a-b77e-3bdd8569d1a2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.183279 Jan 24 22:31:31.223850 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 377/728] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:31 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:31.604868 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c0713a3c-a7aa-4e2d-8fcb-85d030ec72d8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:31.605936 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c0713a3c-a7aa-4e2d-8fcb-85d030ec72d8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:31.617104 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c0713a3c-a7aa-4e2d-8fcb-85d030ec72d8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:31.617727 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c0713a3c-a7aa-4e2d-8fcb-85d030ec72d8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:31.619023 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c0713a3c-a7aa-4e2d-8fcb-85d030ec72d8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:31.619750 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c0713a3c-a7aa-4e2d-8fcb-85d030ec72d8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:31.755254 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c0713a3c-a7aa-4e2d-8fcb-85d030ec72d8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:31.763630 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c0713a3c-a7aa-4e2d-8fcb-85d030ec72d8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1663 microversion: 2.1 time: 0.164885 Jan 24 22:31:31.764224 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 352/729] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:31 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:32.245080 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-68f51290-ce51-428d-b3d6-22303a79bcba tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:32.246003 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-68f51290-ce51-428d-b3d6-22303a79bcba tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:32.254722 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-68f51290-ce51-428d-b3d6-22303a79bcba tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:32.255170 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-68f51290-ce51-428d-b3d6-22303a79bcba tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:32.255940 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-68f51290-ce51-428d-b3d6-22303a79bcba tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:32.256368 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-68f51290-ce51-428d-b3d6-22303a79bcba tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:32.393021 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-68f51290-ce51-428d-b3d6-22303a79bcba tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:32.403755 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-68f51290-ce51-428d-b3d6-22303a79bcba tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.164688 Jan 24 22:31:32.404494 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 378/730] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:32 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:32.784722 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3dcddc1e-6a36-46ad-905e-7cfb6dce530e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:32.785775 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3dcddc1e-6a36-46ad-905e-7cfb6dce530e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:32.796517 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3dcddc1e-6a36-46ad-905e-7cfb6dce530e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:32.796902 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3dcddc1e-6a36-46ad-905e-7cfb6dce530e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:32.797718 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3dcddc1e-6a36-46ad-905e-7cfb6dce530e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:32.798175 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3dcddc1e-6a36-46ad-905e-7cfb6dce530e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:32.954859 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3dcddc1e-6a36-46ad-905e-7cfb6dce530e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:32.962360 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3dcddc1e-6a36-46ad-905e-7cfb6dce530e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1663 microversion: 2.1 time: 0.183847 Jan 24 22:31:32.962934 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 353/731] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:32 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1663 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:33.420788 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f06d8910-3579-4132-823f-78a10f07bf00 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:33.421885 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-f06d8910-3579-4132-823f-78a10f07bf00 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:33.428341 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f06d8910-3579-4132-823f-78a10f07bf00 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:33.428912 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f06d8910-3579-4132-823f-78a10f07bf00 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:33.429814 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f06d8910-3579-4132-823f-78a10f07bf00 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:33.430247 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f06d8910-3579-4132-823f-78a10f07bf00 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:33.564342 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-f06d8910-3579-4132-823f-78a10f07bf00 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:33.571651 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-f06d8910-3579-4132-823f-78a10f07bf00 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.154645 Jan 24 22:31:33.572574 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 379/732] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:33 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:33.979349 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-246bec55-f001-4e69-ba07-462939272ad1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:33.979963 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-246bec55-f001-4e69-ba07-462939272ad1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:33.986788 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-246bec55-f001-4e69-ba07-462939272ad1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:33.987251 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-246bec55-f001-4e69-ba07-462939272ad1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:33.988027 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-246bec55-f001-4e69-ba07-462939272ad1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:33.988469 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-246bec55-f001-4e69-ba07-462939272ad1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:34.129793 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-246bec55-f001-4e69-ba07-462939272ad1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:34.138440 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-246bec55-f001-4e69-ba07-462939272ad1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1663 microversion: 2.1 time: 0.162760 Jan 24 22:31:34.139011 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 354/733] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:33 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:34.588820 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2cf87145-17cd-4dd2-97bd-32c19fec52dd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:34.589402 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2cf87145-17cd-4dd2-97bd-32c19fec52dd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:34.595800 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2cf87145-17cd-4dd2-97bd-32c19fec52dd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:34.596369 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2cf87145-17cd-4dd2-97bd-32c19fec52dd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:34.597159 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2cf87145-17cd-4dd2-97bd-32c19fec52dd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:34.597588 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2cf87145-17cd-4dd2-97bd-32c19fec52dd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:34.728832 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2cf87145-17cd-4dd2-97bd-32c19fec52dd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:34.736617 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2cf87145-17cd-4dd2-97bd-32c19fec52dd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.151527 Jan 24 22:31:34.737242 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 380/734] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:34 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:35.159225 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2608161b-d177-42fc-a12e-69277717e715 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:35.159979 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2608161b-d177-42fc-a12e-69277717e715 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:35.168155 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2608161b-d177-42fc-a12e-69277717e715 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:35.168721 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2608161b-d177-42fc-a12e-69277717e715 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:35.169825 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2608161b-d177-42fc-a12e-69277717e715 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:35.170372 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2608161b-d177-42fc-a12e-69277717e715 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:35.335272 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-2608161b-d177-42fc-a12e-69277717e715 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:35.343435 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2608161b-d177-42fc-a12e-69277717e715 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1667 microversion: 2.1 time: 0.190546 Jan 24 22:31:35.344014 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 355/735] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:35 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1667 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:35.753484 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-cc21e2e3-8cc0-4b88-8849-fb669523492d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:35.754076 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-cc21e2e3-8cc0-4b88-8849-fb669523492d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:35.761121 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cc21e2e3-8cc0-4b88-8849-fb669523492d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:35.761568 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cc21e2e3-8cc0-4b88-8849-fb669523492d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:35.762340 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cc21e2e3-8cc0-4b88-8849-fb669523492d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:35.762773 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cc21e2e3-8cc0-4b88-8849-fb669523492d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:35.903944 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-cc21e2e3-8cc0-4b88-8849-fb669523492d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:35.911895 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-cc21e2e3-8cc0-4b88-8849-fb669523492d tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.162139 Jan 24 22:31:35.912464 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 381/736] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:35 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:36.933744 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7c736a51-07d4-405a-bf97-2e0274fc6fc7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:36.934566 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7c736a51-07d4-405a-bf97-2e0274fc6fc7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:36.943700 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7c736a51-07d4-405a-bf97-2e0274fc6fc7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:36.944140 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7c736a51-07d4-405a-bf97-2e0274fc6fc7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:36.944910 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7c736a51-07d4-405a-bf97-2e0274fc6fc7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:36.945366 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7c736a51-07d4-405a-bf97-2e0274fc6fc7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:37.091666 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7c736a51-07d4-405a-bf97-2e0274fc6fc7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:37.099218 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7c736a51-07d4-405a-bf97-2e0274fc6fc7 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.171803 Jan 24 22:31:37.099765 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 356/737] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:36 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:38.116481 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-02a0ea31-8f93-4c5f-8647-6f9a72ec62c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:38.117097 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-02a0ea31-8f93-4c5f-8647-6f9a72ec62c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:38.123261 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-02a0ea31-8f93-4c5f-8647-6f9a72ec62c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:38.123708 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-02a0ea31-8f93-4c5f-8647-6f9a72ec62c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:38.124481 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-02a0ea31-8f93-4c5f-8647-6f9a72ec62c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:38.124906 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-02a0ea31-8f93-4c5f-8647-6f9a72ec62c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:38.260210 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-02a0ea31-8f93-4c5f-8647-6f9a72ec62c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:38.269024 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-02a0ea31-8f93-4c5f-8647-6f9a72ec62c2 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.156517 Jan 24 22:31:38.269855 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 382/738] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:38 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:38.911374 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-9a1c0caf-fa75-456a-96f5-55e2b8087a16 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "969f9150-aea4-489a-9acb-d683151cc8c5", "device": "/dev/sdb"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:31:38.913033 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-9a1c0caf-fa75-456a-96f5-55e2b8087a16 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:38.919302 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9a1c0caf-fa75-456a-96f5-55e2b8087a16 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:38.919749 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9a1c0caf-fa75-456a-96f5-55e2b8087a16 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:38.920518 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9a1c0caf-fa75-456a-96f5-55e2b8087a16 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:38.920947 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9a1c0caf-fa75-456a-96f5-55e2b8087a16 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:39.223054 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-9a1c0caf-fa75-456a-96f5-55e2b8087a16 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "POST /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314020 Jan 24 22:31:39.223054 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 357/739] 10.222.0.84 () {60 vars in 1322 bytes} [Mon Jan 24 22:31:38 2022] POST /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:31:39.289578 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-780e79d7-40e3-49e2-ab3d-58f78f91eebd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:39.290191 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-780e79d7-40e3-49e2-ab3d-58f78f91eebd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:39.295973 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-780e79d7-40e3-49e2-ab3d-58f78f91eebd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:39.296418 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-780e79d7-40e3-49e2-ab3d-58f78f91eebd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:39.297228 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-780e79d7-40e3-49e2-ab3d-58f78f91eebd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:39.297661 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-780e79d7-40e3-49e2-ab3d-58f78f91eebd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:39.436495 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-780e79d7-40e3-49e2-ab3d-58f78f91eebd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:39.444503 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-780e79d7-40e3-49e2-ab3d-58f78f91eebd tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1522 microversion: 2.1 time: 0.162298 Jan 24 22:31:39.445106 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 383/740] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:39 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:39.878158 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-ba202462-4b4b-4498-8778-ccb13867d6bb req-e5ff4899-6e5a-428d-8365-6b2ee0079961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a871432f-36c3-495a-8269-9de0a0e45315", "name": "network-vif-deleted", "tag": "aabc5fed-da17-478f-810d-56ef4b5caa98"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:31:39.879805 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:31:39.879805 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:31:39.888577 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-ba202462-4b4b-4498-8778-ccb13867d6bb req-e5ff4899-6e5a-428d-8365-6b2ee0079961 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:39.889041 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-ba202462-4b4b-4498-8778-ccb13867d6bb req-e5ff4899-6e5a-428d-8365-6b2ee0079961 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:39.902403 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-ba202462-4b4b-4498-8778-ccb13867d6bb req-e5ff4899-6e5a-428d-8365-6b2ee0079961 service nova] Creating event network-vif-deleted:aabc5fed-da17-478f-810d-56ef4b5caa98 for instance a871432f-36c3-495a-8269-9de0a0e45315 on hv-cinder-81322 Jan 24 22:31:39.907823 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-ba202462-4b4b-4498-8778-ccb13867d6bb req-e5ff4899-6e5a-428d-8365-6b2ee0079961 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034606 Jan 24 22:31:39.908814 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 358/741] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:31:40.460607 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f19934a6-7cfc-4088-926d-f717daac508f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:40.461273 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-f19934a6-7cfc-4088-926d-f717daac508f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:40.468156 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f19934a6-7cfc-4088-926d-f717daac508f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:40.468603 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f19934a6-7cfc-4088-926d-f717daac508f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:40.475775 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f19934a6-7cfc-4088-926d-f717daac508f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:40.476314 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f19934a6-7cfc-4088-926d-f717daac508f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:40.508557 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f19934a6-7cfc-4088-926d-f717daac508f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:40.509295 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f19934a6-7cfc-4088-926d-f717daac508f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:40.509890 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-f19934a6-7cfc-4088-926d-f717daac508f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lazy-loading 'fault' on Instance uuid a871432f-36c3-495a-8269-9de0a0e45315 {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:31:40.561648 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-f19934a6-7cfc-4088-926d-f717daac508f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aef8ec94a2e64529ac89b22625a888c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8dce58932149cbaee5ed5aabdbe3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:31:40.568919 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-f19934a6-7cfc-4088-926d-f717daac508f tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 200 len: 1311 microversion: 2.1 time: 0.111979 Jan 24 22:31:40.569524 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 384/742] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:40 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:31:41.586622 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2486a8c1-c183-4d47-882e-30a895af0137 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:31:41.587272 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2486a8c1-c183-4d47-882e-30a895af0137 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] [instance: a871432f-36c3-495a-8269-9de0a0e45315] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:31:41.594198 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2486a8c1-c183-4d47-882e-30a895af0137 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:41.594641 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2486a8c1-c183-4d47-882e-30a895af0137 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:41.595418 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2486a8c1-c183-4d47-882e-30a895af0137 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:31:41.595842 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2486a8c1-c183-4d47-882e-30a895af0137 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:31:41.613198 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-2486a8c1-c183-4d47-882e-30a895af0137 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] HTTP exception thrown: Instance a871432f-36c3-495a-8269-9de0a0e45315 could not be found. Jan 24 22:31:41.613198 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2486a8c1-c183-4d47-882e-30a895af0137 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] Returning 404 to user: Instance a871432f-36c3-495a-8269-9de0a0e45315 could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:31:41.613198 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2486a8c1-c183-4d47-882e-30a895af0137 tempest-ServerRescueNegativeTestJSON-991784789 tempest-ServerRescueNegativeTestJSON-991784789-project] 10.222.0.84 "GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315" status: 404 len: 111 microversion: 2.1 time: 0.029769 Jan 24 22:31:41.613198 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 359/743] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:31:41 2022] GET /compute/v2.1/servers/a871432f-36c3-495a-8269-9de0a0e45315 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:32:03.964124 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-17b219ee-fe34-4435-a729-1c51bcda1770 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:03.964705 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-17b219ee-fe34-4435-a729-1c51bcda1770 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:03.971682 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-17b219ee-fe34-4435-a729-1c51bcda1770 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:03.972114 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-17b219ee-fe34-4435-a729-1c51bcda1770 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:03.972896 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-17b219ee-fe34-4435-a729-1c51bcda1770 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:03.973352 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-17b219ee-fe34-4435-a729-1c51bcda1770 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:04.051813 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-17b219ee-fe34-4435-a729-1c51bcda1770 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lazy-loading 'services' on Instance uuid f960b38f-f542-4b02-972e-f0c17fe05d4c {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:32:04.123976 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-17b219ee-fe34-4435-a729-1c51bcda1770 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "DELETE /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c/os-volume_attachments/969f9150-aea4-489a-9acb-d683151cc8c5" status: 202 len: 0 microversion: 2.1 time: 0.164239 Jan 24 22:32:04.124519 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 385/744] 10.222.0.84 () {58 vars in 1415 bytes} [Mon Jan 24 22:32:03 2022] DELETE /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c/os-volume_attachments/969f9150-aea4-489a-9acb-d683151cc8c5 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:32:08.434931 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7ae5d6ce-4892-4f72-8fe3-4092bb3a59cc tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:08.435455 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7ae5d6ce-4892-4f72-8fe3-4092bb3a59cc tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:08.441896 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7ae5d6ce-4892-4f72-8fe3-4092bb3a59cc tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:08.442346 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7ae5d6ce-4892-4f72-8fe3-4092bb3a59cc tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:08.443114 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7ae5d6ce-4892-4f72-8fe3-4092bb3a59cc tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:08.443543 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7ae5d6ce-4892-4f72-8fe3-4092bb3a59cc tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:08.468135 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7ae5d6ce-4892-4f72-8fe3-4092bb3a59cc tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Going to try to terminate instance {{(pid=116466) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:32:08.547129 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7ae5d6ce-4892-4f72-8fe3-4092bb3a59cc tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "DELETE /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 204 len: 0 microversion: 2.1 time: 0.115558 Jan 24 22:32:08.547899 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 360/745] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:32:08 2022] DELETE /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:32:08.558665 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-26491e66-ac58-4b8a-809e-93944262e2f2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:08.559527 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-26491e66-ac58-4b8a-809e-93944262e2f2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:08.567445 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-26491e66-ac58-4b8a-809e-93944262e2f2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:08.567901 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-26491e66-ac58-4b8a-809e-93944262e2f2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:08.568720 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-26491e66-ac58-4b8a-809e-93944262e2f2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:08.569400 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-26491e66-ac58-4b8a-809e-93944262e2f2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:08.704132 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-26491e66-ac58-4b8a-809e-93944262e2f2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:08.711951 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-26491e66-ac58-4b8a-809e-93944262e2f2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1512 microversion: 2.1 time: 0.158799 Jan 24 22:32:08.712525 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 386/746] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:08 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:09.730695 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3eca547f-e7c3-4c7c-b0dc-39a42acb6b3d tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:09.731536 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3eca547f-e7c3-4c7c-b0dc-39a42acb6b3d tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:09.740508 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3eca547f-e7c3-4c7c-b0dc-39a42acb6b3d tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:09.740976 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3eca547f-e7c3-4c7c-b0dc-39a42acb6b3d tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:09.742577 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3eca547f-e7c3-4c7c-b0dc-39a42acb6b3d tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:09.743237 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3eca547f-e7c3-4c7c-b0dc-39a42acb6b3d tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:09.892161 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3eca547f-e7c3-4c7c-b0dc-39a42acb6b3d tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:09.899679 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3eca547f-e7c3-4c7c-b0dc-39a42acb6b3d tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1512 microversion: 2.1 time: 0.174053 Jan 24 22:32:09.900221 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 361/747] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:09 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:10.916775 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e37739b1-7112-40ce-a8a3-ab2cbaf139b2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:10.918011 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e37739b1-7112-40ce-a8a3-ab2cbaf139b2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:10.924979 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e37739b1-7112-40ce-a8a3-ab2cbaf139b2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:10.925577 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e37739b1-7112-40ce-a8a3-ab2cbaf139b2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:10.926520 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e37739b1-7112-40ce-a8a3-ab2cbaf139b2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:10.927025 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e37739b1-7112-40ce-a8a3-ab2cbaf139b2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:11.007767 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-9cd53474-8ba4-45c4-93b9-9fa2f785000a req-c5b007e9-55f4-4855-8b42-e155d14a43b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f960b38f-f542-4b02-972e-f0c17fe05d4c", "name": "network-vif-deleted", "tag": "3b795779-9a59-417a-a073-f7d208152ddb"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:11.008939 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e37739b1-7112-40ce-a8a3-ab2cbaf139b2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:11.010034 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:32:11.010034 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:32:11.017320 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e37739b1-7112-40ce-a8a3-ab2cbaf139b2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 200 len: 1470 microversion: 2.1 time: 0.104054 Jan 24 22:32:11.026616 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 387/748] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:10 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 1470 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:11.026827 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-9cd53474-8ba4-45c4-93b9-9fa2f785000a req-c5b007e9-55f4-4855-8b42-e155d14a43b3 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:11.026827 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-9cd53474-8ba4-45c4-93b9-9fa2f785000a req-c5b007e9-55f4-4855-8b42-e155d14a43b3 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:11.033260 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-9cd53474-8ba4-45c4-93b9-9fa2f785000a req-c5b007e9-55f4-4855-8b42-e155d14a43b3 service nova] Creating event network-vif-deleted:3b795779-9a59-417a-a073-f7d208152ddb for instance f960b38f-f542-4b02-972e-f0c17fe05d4c on hv-cinder-81322 Jan 24 22:32:11.038715 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-9cd53474-8ba4-45c4-93b9-9fa2f785000a req-c5b007e9-55f4-4855-8b42-e155d14a43b3 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035376 Jan 24 22:32:11.039578 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 362/749] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:32:12.034040 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-76d7adf4-2e81-41aa-a67e-54ec81658c71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:12.034774 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-76d7adf4-2e81-41aa-a67e-54ec81658c71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: f960b38f-f542-4b02-972e-f0c17fe05d4c] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:12.041062 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-76d7adf4-2e81-41aa-a67e-54ec81658c71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:12.041499 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-76d7adf4-2e81-41aa-a67e-54ec81658c71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:12.042275 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-76d7adf4-2e81-41aa-a67e-54ec81658c71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:12.042911 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-76d7adf4-2e81-41aa-a67e-54ec81658c71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:12.056282 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-76d7adf4-2e81-41aa-a67e-54ec81658c71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] HTTP exception thrown: Instance f960b38f-f542-4b02-972e-f0c17fe05d4c could not be found. Jan 24 22:32:12.056858 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-76d7adf4-2e81-41aa-a67e-54ec81658c71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Returning 404 to user: Instance f960b38f-f542-4b02-972e-f0c17fe05d4c could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:32:12.057697 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-76d7adf4-2e81-41aa-a67e-54ec81658c71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c" status: 404 len: 111 microversion: 2.1 time: 0.027389 Jan 24 22:32:12.058310 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 388/750] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:12 2022] GET /compute/v2.1/servers/f960b38f-f542-4b02-972e-f0c17fe05d4c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:32:22.924363 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c9d87d9b-fba5-4246-aaf4-791af7d7add8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:22.924946 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c9d87d9b-fba5-4246-aaf4-791af7d7add8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:22.931919 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c9d87d9b-fba5-4246-aaf4-791af7d7add8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:22.932369 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c9d87d9b-fba5-4246-aaf4-791af7d7add8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:22.933202 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c9d87d9b-fba5-4246-aaf4-791af7d7add8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:22.933636 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c9d87d9b-fba5-4246-aaf4-791af7d7add8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:22.963886 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c9d87d9b-fba5-4246-aaf4-791af7d7add8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/os-volume_attachments/245cf039-fa8f-49c9-9dea-adf383ffad5b" status: 200 len: 194 microversion: 2.20 time: 0.044436 Jan 24 22:32:22.969891 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 363/751] 10.222.0.84 () {60 vars in 1453 bytes} [Mon Jan 24 22:32:22 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/os-volume_attachments/245cf039-fa8f-49c9-9dea-adf383ffad5b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:32:23.005897 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-034cd303-6e16-4122-bbd7-be25737d5e6a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1110605465", "imageRef": "4fe12948-6887-4759-900b-f3ee39409e75", "flavorRef": "452", "networks": [{"uuid": "e8888219-d5d2-46f9-84f1-df880fd5a58a"}]}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:23.024735 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b2ec9ec2-1423-4599-b7fa-19a0009ae418 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:23.025695 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b2ec9ec2-1423-4599-b7fa-19a0009ae418 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:23.032411 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b2ec9ec2-1423-4599-b7fa-19a0009ae418 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:23.033046 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b2ec9ec2-1423-4599-b7fa-19a0009ae418 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:23.033828 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b2ec9ec2-1423-4599-b7fa-19a0009ae418 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:23.034260 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b2ec9ec2-1423-4599-b7fa-19a0009ae418 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:23.058980 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.network.neutron [None req-034cd303-6e16-4122-bbd7-be25737d5e6a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] validate_networks() for [('e8888219-d5d2-46f9-84f1-df880fd5a58a', None, None, None, None, None)] {{(pid=116467) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:32:23.117789 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.objects.instance [None req-b2ec9ec2-1423-4599-b7fa-19a0009ae418 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lazy-loading 'services' on Instance uuid 5995cfc4-026f-45ae-a918-0bc8f1bdc025 {{(pid=116466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:32:23.189158 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b2ec9ec2-1423-4599-b7fa-19a0009ae418 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "DELETE /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/os-volume_attachments/245cf039-fa8f-49c9-9dea-adf383ffad5b" status: 202 len: 0 microversion: 2.20 time: 0.167832 Jan 24 22:32:23.191194 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 364/752] 10.222.0.84 () {60 vars in 1456 bytes} [Mon Jan 24 22:32:23 2022] DELETE /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/os-volume_attachments/245cf039-fa8f-49c9-9dea-adf383ffad5b => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:32:23.199383 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6a89eead-db3f-469c-8e11-ca57532dbc0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:23.200420 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6a89eead-db3f-469c-8e11-ca57532dbc0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:23.210218 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6a89eead-db3f-469c-8e11-ca57532dbc0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:23.210683 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6a89eead-db3f-469c-8e11-ca57532dbc0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:23.211462 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6a89eead-db3f-469c-8e11-ca57532dbc0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:23.211888 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6a89eead-db3f-469c-8e11-ca57532dbc0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:23.245770 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6a89eead-db3f-469c-8e11-ca57532dbc0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050078 Jan 24 22:32:23.246494 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 365/753] 10.222.0.84 () {60 vars in 1342 bytes} [Mon Jan 24 22:32:23 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:32:23.422681 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-034cd303-6e16-4122-bbd7-be25737d5e6a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Flavor limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:32:23.423038 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-034cd303-6e16-4122-bbd7-be25737d5e6a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Image limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:32:23.423540 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-034cd303-6e16-4122-bbd7-be25737d5e6a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Flavor pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:32:23.423947 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-034cd303-6e16-4122-bbd7-be25737d5e6a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Image pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:32:23.424357 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-034cd303-6e16-4122-bbd7-be25737d5e6a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:32:23.433268 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-034cd303-6e16-4122-bbd7-be25737d5e6a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:23.433710 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-034cd303-6e16-4122-bbd7-be25737d5e6a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:23.434525 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-034cd303-6e16-4122-bbd7-be25737d5e6a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:23.434951 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-034cd303-6e16-4122-bbd7-be25737d5e6a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:23.450817 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-034cd303-6e16-4122-bbd7-be25737d5e6a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Getting quotas for project cc5a655a0b0f4f0482453bde6f196195. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:32:23.455251 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-034cd303-6e16-4122-bbd7-be25737d5e6a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Getting quotas for user 9b4ada062ed8433da1795195691f241c and project cc5a655a0b0f4f0482453bde6f196195. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:32:23.465966 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-034cd303-6e16-4122-bbd7-be25737d5e6a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Going to run 1 instances... {{(pid=116467) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:32:23.468396 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-034cd303-6e16-4122-bbd7-be25737d5e6a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fe12948-6887-4759-900b-f3ee39409e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:32:23.513689 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-034cd303-6e16-4122-bbd7-be25737d5e6a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511415 Jan 24 22:32:23.514680 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 389/754] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:32:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 24 22:32:23.525127 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-4c0ee0e8-9938-4017-bac8-8e282ff88184 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:23.525854 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-4c0ee0e8-9938-4017-bac8-8e282ff88184 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:23.577003 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-4c0ee0e8-9938-4017-bac8-8e282ff88184 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:23.583661 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-4c0ee0e8-9938-4017-bac8-8e282ff88184 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce" status: 200 len: 1219 microversion: 2.1 time: 0.062273 Jan 24 22:32:23.584336 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 366/755] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:23 2022] GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:32:24.258358 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ff9c8919-fd5a-49c4-862e-5d60e5641570 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:24.259664 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ff9c8919-fd5a-49c4-862e-5d60e5641570 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:24.267487 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ff9c8919-fd5a-49c4-862e-5d60e5641570 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:24.267942 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ff9c8919-fd5a-49c4-862e-5d60e5641570 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:24.268736 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ff9c8919-fd5a-49c4-862e-5d60e5641570 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:24.269196 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ff9c8919-fd5a-49c4-862e-5d60e5641570 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:24.300682 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ff9c8919-fd5a-49c4-862e-5d60e5641570 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046705 Jan 24 22:32:24.301252 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 390/756] 10.222.0.84 () {60 vars in 1342 bytes} [Mon Jan 24 22:32:24 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:24.364807 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1dc6b53b-7053-441e-93fb-ef821aa781b5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:24.365624 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-1dc6b53b-7053-441e-93fb-ef821aa781b5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:24.372156 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1dc6b53b-7053-441e-93fb-ef821aa781b5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:24.372611 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1dc6b53b-7053-441e-93fb-ef821aa781b5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:24.373428 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1dc6b53b-7053-441e-93fb-ef821aa781b5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:24.373878 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1dc6b53b-7053-441e-93fb-ef821aa781b5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:24.402912 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-1dc6b53b-7053-441e-93fb-ef821aa781b5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Going to try to terminate instance {{(pid=116466) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:32:24.481909 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-1dc6b53b-7053-441e-93fb-ef821aa781b5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "DELETE /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 204 len: 0 microversion: 2.20 time: 0.120514 Jan 24 22:32:24.482741 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 367/757] 10.222.0.84 () {60 vars in 1279 bytes} [Mon Jan 24 22:32:24 2022] DELETE /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 24 22:32:24.493370 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-aff6a845-3b19-4136-8d3c-19d2f14e0385 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:24.493930 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-aff6a845-3b19-4136-8d3c-19d2f14e0385 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:24.500286 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-aff6a845-3b19-4136-8d3c-19d2f14e0385 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:24.500752 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-aff6a845-3b19-4136-8d3c-19d2f14e0385 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:24.501558 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-aff6a845-3b19-4136-8d3c-19d2f14e0385 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:24.502004 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-aff6a845-3b19-4136-8d3c-19d2f14e0385 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:24.602401 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c9e3514f-8554-4f3f-a627-76d71a64f8d1 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:24.603741 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c9e3514f-8554-4f3f-a627-76d71a64f8d1 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:24.613206 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c9e3514f-8554-4f3f-a627-76d71a64f8d1 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:24.613206 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c9e3514f-8554-4f3f-a627-76d71a64f8d1 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:24.613971 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c9e3514f-8554-4f3f-a627-76d71a64f8d1 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:24.614660 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c9e3514f-8554-4f3f-a627-76d71a64f8d1 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:24.710004 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c9e3514f-8554-4f3f-a627-76d71a64f8d1 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:24.727827 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c9e3514f-8554-4f3f-a627-76d71a64f8d1 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce" status: 200 len: 1279 microversion: 2.1 time: 0.131098 Jan 24 22:32:24.737788 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-aff6a845-3b19-4136-8d3c-19d2f14e0385 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:24.737951 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 368/758] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:24 2022] GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce => generated 1279 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:24.744237 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-aff6a845-3b19-4136-8d3c-19d2f14e0385 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:24.745989 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-aff6a845-3b19-4136-8d3c-19d2f14e0385 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:24.747282 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-aff6a845-3b19-4136-8d3c-19d2f14e0385 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.259874 Jan 24 22:32:24.748160 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 391/759] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:24 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:32:25.745849 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-22f7dc6d-17ca-4e22-a610-d8dbabc4cb38 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:25.746881 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-22f7dc6d-17ca-4e22-a610-d8dbabc4cb38 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:25.754646 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-22f7dc6d-17ca-4e22-a610-d8dbabc4cb38 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:25.755177 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-22f7dc6d-17ca-4e22-a610-d8dbabc4cb38 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:25.756037 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-22f7dc6d-17ca-4e22-a610-d8dbabc4cb38 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:25.756535 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-22f7dc6d-17ca-4e22-a610-d8dbabc4cb38 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:25.778905 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a8566a1e-3ada-4ef0-9e38-f8aa13766559 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:25.787671 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a8566a1e-3ada-4ef0-9e38-f8aa13766559 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:25.797242 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a8566a1e-3ada-4ef0-9e38-f8aa13766559 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:25.801184 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a8566a1e-3ada-4ef0-9e38-f8aa13766559 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:25.802217 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a8566a1e-3ada-4ef0-9e38-f8aa13766559 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:25.813687 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a8566a1e-3ada-4ef0-9e38-f8aa13766559 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:26.110707 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-22f7dc6d-17ca-4e22-a610-d8dbabc4cb38 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:26.122465 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-22f7dc6d-17ca-4e22-a610-d8dbabc4cb38 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce" status: 200 len: 1319 microversion: 2.1 time: 0.381020 Jan 24 22:32:26.123077 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 369/760] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:25 2022] GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:26.128252 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a8566a1e-3ada-4ef0-9e38-f8aa13766559 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:26.137027 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a8566a1e-3ada-4ef0-9e38-f8aa13766559 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:26.138544 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a8566a1e-3ada-4ef0-9e38-f8aa13766559 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:26.139724 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a8566a1e-3ada-4ef0-9e38-f8aa13766559 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.364863 Jan 24 22:32:26.140282 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 392/761] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:25 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:32:26.807522 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-f5366c1b-99ed-47a6-bdad-184a01c4f416 req-c6b10f3c-e760-4399-be5a-8b09881ecd4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce", "tag": "f126ddae-4e06-40f8-ac9c-2e1f28a67f36"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:26.810882 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:32:26.810882 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:32:26.821438 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-f5366c1b-99ed-47a6-bdad-184a01c4f416 req-c6b10f3c-e760-4399-be5a-8b09881ecd4b service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:26.822051 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-f5366c1b-99ed-47a6-bdad-184a01c4f416 req-c6b10f3c-e760-4399-be5a-8b09881ecd4b service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:26.843279 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-f5366c1b-99ed-47a6-bdad-184a01c4f416 req-c6b10f3c-e760-4399-be5a-8b09881ecd4b service nova] Creating event network-changed:f126ddae-4e06-40f8-ac9c-2e1f28a67f36 for instance 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce on hv-cinder-81322 Jan 24 22:32:26.849535 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-f5366c1b-99ed-47a6-bdad-184a01c4f416 req-c6b10f3c-e760-4399-be5a-8b09881ecd4b service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046874 Jan 24 22:32:26.850706 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 370/762] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:32:26.975130 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-156d802d-faac-4a18-87eb-a3630cf4c077 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:26.976047 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-156d802d-faac-4a18-87eb-a3630cf4c077 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:26.982395 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-156d802d-faac-4a18-87eb-a3630cf4c077 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:26.982845 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-156d802d-faac-4a18-87eb-a3630cf4c077 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:26.984784 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-156d802d-faac-4a18-87eb-a3630cf4c077 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:26.984784 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-156d802d-faac-4a18-87eb-a3630cf4c077 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:27.022241 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-156d802d-faac-4a18-87eb-a3630cf4c077 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050663 Jan 24 22:32:27.023395 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 393/763] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:32:26 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 22:32:27.098658 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a8c9a96e-d607-40e9-9e82-6707ab4a7fe7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:27.099681 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a8c9a96e-d607-40e9-9e82-6707ab4a7fe7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:27.115155 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a8c9a96e-d607-40e9-9e82-6707ab4a7fe7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:27.115819 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a8c9a96e-d607-40e9-9e82-6707ab4a7fe7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:27.116815 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a8c9a96e-d607-40e9-9e82-6707ab4a7fe7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:27.117468 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a8c9a96e-d607-40e9-9e82-6707ab4a7fe7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:27.139821 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-925a99c7-241e-46f4-ace1-70b58ceb3b5f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:27.140435 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-925a99c7-241e-46f4-ace1-70b58ceb3b5f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:27.148272 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-925a99c7-241e-46f4-ace1-70b58ceb3b5f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:27.148860 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-925a99c7-241e-46f4-ace1-70b58ceb3b5f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:27.149531 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-925a99c7-241e-46f4-ace1-70b58ceb3b5f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:27.149954 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-925a99c7-241e-46f4-ace1-70b58ceb3b5f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:27.171589 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a8c9a96e-d607-40e9-9e82-6707ab4a7fe7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Going to try to terminate instance {{(pid=116466) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:32:27.313871 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a8c9a96e-d607-40e9-9e82-6707ab4a7fe7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "DELETE /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 204 len: 0 microversion: 2.1 time: 0.218077 Jan 24 22:32:27.315062 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 371/764] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:32:27 2022] DELETE /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:32:27.323716 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-cca96c50-19fa-4fb6-9c22-630a5357f114 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:27.329182 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-cca96c50-19fa-4fb6-9c22-630a5357f114 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:27.335154 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cca96c50-19fa-4fb6-9c22-630a5357f114 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:27.335828 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cca96c50-19fa-4fb6-9c22-630a5357f114 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:27.336785 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cca96c50-19fa-4fb6-9c22-630a5357f114 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:27.337405 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cca96c50-19fa-4fb6-9c22-630a5357f114 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:27.441504 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-925a99c7-241e-46f4-ace1-70b58ceb3b5f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:27.455182 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-925a99c7-241e-46f4-ace1-70b58ceb3b5f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce" status: 200 len: 1319 microversion: 2.1 time: 0.317822 Jan 24 22:32:27.456978 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 394/765] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:27 2022] GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:32:27.465713 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ffbc1781-4f86-4cfd-a551-81cc93781e92 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:27.466796 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ffbc1781-4f86-4cfd-a551-81cc93781e92 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:27.478170 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ffbc1781-4f86-4cfd-a551-81cc93781e92 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:27.479392 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ffbc1781-4f86-4cfd-a551-81cc93781e92 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:27.481267 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ffbc1781-4f86-4cfd-a551-81cc93781e92 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:27.482300 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ffbc1781-4f86-4cfd-a551-81cc93781e92 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:27.935462 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-cca96c50-19fa-4fb6-9c22-630a5357f114 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:27.945706 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-cca96c50-19fa-4fb6-9c22-630a5357f114 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:27.947523 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-cca96c50-19fa-4fb6-9c22-630a5357f114 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:27.948888 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-cca96c50-19fa-4fb6-9c22-630a5357f114 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 200 len: 1720 microversion: 2.20 time: 0.632638 Jan 24 22:32:27.949620 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 372/766] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:27 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 1720 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:32:28.070568 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ffbc1781-4f86-4cfd-a551-81cc93781e92 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:28.087591 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ffbc1781-4f86-4cfd-a551-81cc93781e92 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1673 microversion: 2.1 time: 0.626688 Jan 24 22:32:28.088414 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 395/767] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:27 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1673 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:28.289349 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-faa8dd81-f6d4-46b6-8e01-457b1950947a req-a48e4b47-2c34-4ed8-acf1-2ce5c3ca1452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5995cfc4-026f-45ae-a918-0bc8f1bdc025", "name": "network-vif-deleted", "tag": "987c8810-0969-4e25-bb03-7993afce108d"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:28.291640 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:32:28.291640 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:32:28.305809 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-faa8dd81-f6d4-46b6-8e01-457b1950947a req-a48e4b47-2c34-4ed8-acf1-2ce5c3ca1452 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:28.306259 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-faa8dd81-f6d4-46b6-8e01-457b1950947a req-a48e4b47-2c34-4ed8-acf1-2ce5c3ca1452 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:28.318613 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-faa8dd81-f6d4-46b6-8e01-457b1950947a req-a48e4b47-2c34-4ed8-acf1-2ce5c3ca1452 service nova] Creating event network-vif-deleted:987c8810-0969-4e25-bb03-7993afce108d for instance 5995cfc4-026f-45ae-a918-0bc8f1bdc025 on hv-cinder-81322 Jan 24 22:32:28.323788 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-faa8dd81-f6d4-46b6-8e01-457b1950947a req-a48e4b47-2c34-4ed8-acf1-2ce5c3ca1452 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038217 Jan 24 22:32:28.324977 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 373/768] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:32:28.474664 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ee41beb2-1004-4fcf-a1af-5526fe13b468 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:28.475665 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ee41beb2-1004-4fcf-a1af-5526fe13b468 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:28.487895 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ee41beb2-1004-4fcf-a1af-5526fe13b468 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:28.488792 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ee41beb2-1004-4fcf-a1af-5526fe13b468 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:28.490021 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ee41beb2-1004-4fcf-a1af-5526fe13b468 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:28.491850 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ee41beb2-1004-4fcf-a1af-5526fe13b468 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:28.703808 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ee41beb2-1004-4fcf-a1af-5526fe13b468 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:28.712028 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ee41beb2-1004-4fcf-a1af-5526fe13b468 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce" status: 200 len: 1319 microversion: 2.1 time: 0.242780 Jan 24 22:32:28.712770 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 396/769] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:28 2022] GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:28.969575 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-971774f2-4109-4150-b7cf-783f3961dff6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:28.971345 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-971774f2-4109-4150-b7cf-783f3961dff6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:28.997035 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-971774f2-4109-4150-b7cf-783f3961dff6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:28.997764 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-971774f2-4109-4150-b7cf-783f3961dff6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:29.000164 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-971774f2-4109-4150-b7cf-783f3961dff6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:29.000776 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-971774f2-4109-4150-b7cf-783f3961dff6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:29.028425 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-971774f2-4109-4150-b7cf-783f3961dff6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] HTTP exception thrown: Instance 5995cfc4-026f-45ae-a918-0bc8f1bdc025 could not be found. Jan 24 22:32:29.032170 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-971774f2-4109-4150-b7cf-783f3961dff6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Returning 404 to user: Instance 5995cfc4-026f-45ae-a918-0bc8f1bdc025 could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:32:29.033044 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-971774f2-4109-4150-b7cf-783f3961dff6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 404 len: 111 microversion: 2.20 time: 0.068996 Jan 24 22:32:29.033605 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 374/770] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:28 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 22:32:29.042505 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b90611f1-ad03-49a1-bcb6-0c08618ee33f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '.version_select at 0x7f7e5d18d790>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:29.078962 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b90611f1-ad03-49a1-bcb6-0c08618ee33f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-218249340" status: 204 len: 0 microversion: 2.20 time: 0.040502 Jan 24 22:32:29.083188 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 397/771] 10.222.0.84 () {60 vars in 1258 bytes} [Mon Jan 24 22:32:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-218249340 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 24 22:32:29.108670 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6b0c61d2-5f86-42ea-ae32-122b47bf2c47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:29.111880 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6b0c61d2-5f86-42ea-ae32-122b47bf2c47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:29.119768 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6b0c61d2-5f86-42ea-ae32-122b47bf2c47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:29.120263 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6b0c61d2-5f86-42ea-ae32-122b47bf2c47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:29.121267 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6b0c61d2-5f86-42ea-ae32-122b47bf2c47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:29.122466 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6b0c61d2-5f86-42ea-ae32-122b47bf2c47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:29.428152 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-6b0c61d2-5f86-42ea-ae32-122b47bf2c47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:29.437934 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6b0c61d2-5f86-42ea-ae32-122b47bf2c47 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1673 microversion: 2.1 time: 0.334742 Jan 24 22:32:29.439040 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 375/772] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:29 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1673 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:29.729947 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3249a84e-7318-465e-9947-1162409de52d tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:29.730745 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-3249a84e-7318-465e-9947-1162409de52d tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:29.745528 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3249a84e-7318-465e-9947-1162409de52d tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:29.746054 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3249a84e-7318-465e-9947-1162409de52d tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:29.748523 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3249a84e-7318-465e-9947-1162409de52d tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:29.750861 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3249a84e-7318-465e-9947-1162409de52d tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:30.060423 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3249a84e-7318-465e-9947-1162409de52d tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:30.069601 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-3249a84e-7318-465e-9947-1162409de52d tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce" status: 200 len: 1319 microversion: 2.1 time: 0.344164 Jan 24 22:32:30.070187 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 398/773] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:29 2022] GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:30.070318 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b359c7a2-726e-4df7-b8a1-c46c0c6d6eeb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'create', calling method: .version_select at 0x7f7e5d1d8940>, body: {"keypair": {"name": "tempest-keypair-1768446399"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:30.091664 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-b359c7a2-726e-4df7-b8a1-c46c0c6d6eeb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Getting quotas for project 2480860d99554b1c8d0c7845602c854e. Resources: {'key_pairs'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:32:30.097137 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-b359c7a2-726e-4df7-b8a1-c46c0c6d6eeb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Getting quotas for user e3e0792aba0a4e12bc29eceb648916eb and project 2480860d99554b1c8d0c7845602c854e. Resources: {'key_pairs'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:32:30.434304 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-b359c7a2-726e-4df7-b8a1-c46c0c6d6eeb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Getting quotas for project 2480860d99554b1c8d0c7845602c854e. Resources: {'key_pairs'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:32:30.438619 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-b359c7a2-726e-4df7-b8a1-c46c0c6d6eeb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Getting quotas for user e3e0792aba0a4e12bc29eceb648916eb and project 2480860d99554b1c8d0c7845602c854e. Resources: {'key_pairs'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:32:30.455629 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b359c7a2-726e-4df7-b8a1-c46c0c6d6eeb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.389681 Jan 24 22:32:30.456218 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9b6d502f-d9a6-41b0-ae12-de2b1b78f631 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:30.456886 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9b6d502f-d9a6-41b0-ae12-de2b1b78f631 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:30.458111 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 376/774] 10.222.0.84 () {62 vars in 1198 bytes} [Mon Jan 24 22:32:30 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 394 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 24 22:32:30.466938 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9b6d502f-d9a6-41b0-ae12-de2b1b78f631 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:30.467469 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9b6d502f-d9a6-41b0-ae12-de2b1b78f631 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:30.468298 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9b6d502f-d9a6-41b0-ae12-de2b1b78f631 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:30.471499 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9b6d502f-d9a6-41b0-ae12-de2b1b78f631 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:30.742606 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-9b6d502f-d9a6-41b0-ae12-de2b1b78f631 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:30.754625 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9b6d502f-d9a6-41b0-ae12-de2b1b78f631 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1673 microversion: 2.1 time: 0.302522 Jan 24 22:32:30.760110 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 399/775] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:30 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1673 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:32:31.089700 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-0931cbaf-b60e-4893-b16a-30db609870dd tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:31.091635 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-0931cbaf-b60e-4893-b16a-30db609870dd tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:31.104467 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0931cbaf-b60e-4893-b16a-30db609870dd tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:31.106530 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0931cbaf-b60e-4893-b16a-30db609870dd tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:31.109730 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0931cbaf-b60e-4893-b16a-30db609870dd tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:31.111523 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-0931cbaf-b60e-4893-b16a-30db609870dd tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:31.278131 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-383d6e45-0970-419e-ac64-8004c3548f1f req-059b7571-1db2-466d-87a2-0246a8e60228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a250b35-2478-48ce-b61d-9eae8933d5fb", "name": "network-vif-deleted", "tag": "1b9f98aa-61b7-471d-a113-b3ce2247724e"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:31.280401 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:32:31.280401 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:32:31.314134 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-383d6e45-0970-419e-ac64-8004c3548f1f req-059b7571-1db2-466d-87a2-0246a8e60228 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:31.315711 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-383d6e45-0970-419e-ac64-8004c3548f1f req-059b7571-1db2-466d-87a2-0246a8e60228 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:31.348820 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-383d6e45-0970-419e-ac64-8004c3548f1f req-059b7571-1db2-466d-87a2-0246a8e60228 service nova] Creating event network-vif-deleted:1b9f98aa-61b7-471d-a113-b3ce2247724e for instance 3a250b35-2478-48ce-b61d-9eae8933d5fb on hv-cinder-81322 Jan 24 22:32:31.370042 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-383d6e45-0970-419e-ac64-8004c3548f1f req-059b7571-1db2-466d-87a2-0246a8e60228 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096415 Jan 24 22:32:31.370932 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 400/776] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:32:31.425609 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-0931cbaf-b60e-4893-b16a-30db609870dd tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:31.433352 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-0931cbaf-b60e-4893-b16a-30db609870dd tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce" status: 200 len: 1319 microversion: 2.1 time: 0.349226 Jan 24 22:32:31.436787 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 377/777] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:31 2022] GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:31.777950 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b96bb8ee-c7a3-4afe-b724-c32b28e1e87e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:31.779854 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b96bb8ee-c7a3-4afe-b724-c32b28e1e87e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:31.792064 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b96bb8ee-c7a3-4afe-b724-c32b28e1e87e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:31.795014 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b96bb8ee-c7a3-4afe-b724-c32b28e1e87e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:31.799349 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b96bb8ee-c7a3-4afe-b724-c32b28e1e87e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:31.800702 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b96bb8ee-c7a3-4afe-b724-c32b28e1e87e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:31.897080 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b96bb8ee-c7a3-4afe-b724-c32b28e1e87e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:31.897531 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b96bb8ee-c7a3-4afe-b724-c32b28e1e87e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:31.897991 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-b96bb8ee-c7a3-4afe-b724-c32b28e1e87e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lazy-loading 'fault' on Instance uuid 3a250b35-2478-48ce-b61d-9eae8933d5fb {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:32:31.977834 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b96bb8ee-c7a3-4afe-b724-c32b28e1e87e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:31.986458 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b96bb8ee-c7a3-4afe-b724-c32b28e1e87e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 200 len: 1327 microversion: 2.1 time: 0.213320 Jan 24 22:32:31.987045 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 401/778] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:31 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 1327 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:32.455390 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-697b7495-2224-4c6b-a7b3-773a83f936b3 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:32.456669 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-697b7495-2224-4c6b-a7b3-773a83f936b3 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:32.465660 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-697b7495-2224-4c6b-a7b3-773a83f936b3 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:32.466347 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-697b7495-2224-4c6b-a7b3-773a83f936b3 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:32.467351 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-697b7495-2224-4c6b-a7b3-773a83f936b3 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:32.468952 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-697b7495-2224-4c6b-a7b3-773a83f936b3 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:32.649103 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-697b7495-2224-4c6b-a7b3-773a83f936b3 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:32.662417 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-697b7495-2224-4c6b-a7b3-773a83f936b3 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce" status: 200 len: 1319 microversion: 2.1 time: 0.212897 Jan 24 22:32:32.663169 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 378/779] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:32 2022] GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:32.785202 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6b39f37e-c62e-4d43-956c-407fa4999f06 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-759267998", "imageRef": "4fe12948-6887-4759-900b-f3ee39409e75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d56f692-32cb-491f-92de-425cd4663a5e"}], "security_groups": [{"name": "tempest-securitygroup--1253938418"}], "key_name": "tempest-keypair-1768446399", "user_data": "}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:32.968550 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.network.neutron [None req-6b39f37e-c62e-4d43-956c-407fa4999f06 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] validate_networks() for [('8d56f692-32cb-491f-92de-425cd4663a5e', None, None, None, None, None)] {{(pid=116467) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:32:33.007688 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-f1b23837-d736-41d8-8bdb-357edcf68d01 req-88da92a1-67a7-4aac-bcbe-f0d9bda55a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce", "name": "network-vif-plugged", "status": "completed", "tag": "f126ddae-4e06-40f8-ac9c-2e1f28a67f36"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:33.011361 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:32:33.011361 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:32:33.020698 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-f1b23837-d736-41d8-8bdb-357edcf68d01 req-88da92a1-67a7-4aac-bcbe-f0d9bda55a36 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:33.021686 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-f1b23837-d736-41d8-8bdb-357edcf68d01 req-88da92a1-67a7-4aac-bcbe-f0d9bda55a36 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:33.036137 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-f1b23837-d736-41d8-8bdb-357edcf68d01 req-88da92a1-67a7-4aac-bcbe-f0d9bda55a36 service nova] Creating event network-vif-plugged:f126ddae-4e06-40f8-ac9c-2e1f28a67f36 for instance 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce on hv-cinder-81322 Jan 24 22:32:33.043382 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-f1b23837-d736-41d8-8bdb-357edcf68d01 req-88da92a1-67a7-4aac-bcbe-f0d9bda55a36 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047538 Jan 24 22:32:33.044600 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 379/780] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:32:33.053162 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-f068393d-d186-4f58-a39a-ce139783f9c1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:33.054260 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-f068393d-d186-4f58-a39a-ce139783f9c1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:33.063342 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f068393d-d186-4f58-a39a-ce139783f9c1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:33.064051 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f068393d-d186-4f58-a39a-ce139783f9c1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:33.078765 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f068393d-d186-4f58-a39a-ce139783f9c1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:33.080632 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f068393d-d186-4f58-a39a-ce139783f9c1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:33.102618 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-f068393d-d186-4f58-a39a-ce139783f9c1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] HTTP exception thrown: Instance 3a250b35-2478-48ce-b61d-9eae8933d5fb could not be found. Jan 24 22:32:33.103233 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-f068393d-d186-4f58-a39a-ce139783f9c1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Returning 404 to user: Instance 3a250b35-2478-48ce-b61d-9eae8933d5fb could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:32:33.104290 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-f068393d-d186-4f58-a39a-ce139783f9c1 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 404 len: 111 microversion: 2.1 time: 0.057834 Jan 24 22:32:33.105060 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 380/781] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:33 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:32:33.116584 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-03abacea-00e4-4463-a748-35cd2fe8a8cf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '.version_select at 0x7f7e5d1f4820>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:33.164212 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-03abacea-00e4-4463-a748-35cd2fe8a8cf tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162611317" status: 202 len: 0 microversion: 2.1 time: 0.054071 Jan 24 22:32:33.167173 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 381/782] 10.222.0.84 () {58 vars in 1220 bytes} [Mon Jan 24 22:32:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162611317 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:32:33.679872 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-d0bc182b-4f75-421d-b2de-6037254bfb71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:33.680760 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d0bc182b-4f75-421d-b2de-6037254bfb71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:33.688257 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d0bc182b-4f75-421d-b2de-6037254bfb71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:33.688695 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d0bc182b-4f75-421d-b2de-6037254bfb71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:33.689550 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d0bc182b-4f75-421d-b2de-6037254bfb71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:33.689977 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d0bc182b-4f75-421d-b2de-6037254bfb71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:33.706238 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-6b39f37e-c62e-4d43-956c-407fa4999f06 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Flavor limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:32:33.706754 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-6b39f37e-c62e-4d43-956c-407fa4999f06 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Image limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:32:33.707405 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-6b39f37e-c62e-4d43-956c-407fa4999f06 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Flavor pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:32:33.707988 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-6b39f37e-c62e-4d43-956c-407fa4999f06 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Image pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:32:33.708363 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-6b39f37e-c62e-4d43-956c-407fa4999f06 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:32:33.717330 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6b39f37e-c62e-4d43-956c-407fa4999f06 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:33.717824 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6b39f37e-c62e-4d43-956c-407fa4999f06 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:33.718771 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6b39f37e-c62e-4d43-956c-407fa4999f06 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:33.719416 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6b39f37e-c62e-4d43-956c-407fa4999f06 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:33.736639 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-6b39f37e-c62e-4d43-956c-407fa4999f06 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Getting quotas for project 2480860d99554b1c8d0c7845602c854e. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:32:33.740601 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-6b39f37e-c62e-4d43-956c-407fa4999f06 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Getting quotas for user e3e0792aba0a4e12bc29eceb648916eb and project 2480860d99554b1c8d0c7845602c854e. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:32:33.754265 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6b39f37e-c62e-4d43-956c-407fa4999f06 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Going to run 1 instances... {{(pid=116467) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:32:33.757707 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6b39f37e-c62e-4d43-956c-407fa4999f06 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fe12948-6887-4759-900b-f3ee39409e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:32:33.808388 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6b39f37e-c62e-4d43-956c-407fa4999f06 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.028114 Jan 24 22:32:33.809749 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 402/783] 10.222.0.84 () {62 vars in 1187 bytes} [Mon Jan 24 22:32:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 24 22:32:33.821891 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e6e03ad7-38cd-426a-9dcd-1a96f564b35a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:33.822521 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e6e03ad7-38cd-426a-9dcd-1a96f564b35a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:33.937194 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e6e03ad7-38cd-426a-9dcd-1a96f564b35a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:33.946933 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e6e03ad7-38cd-426a-9dcd-1a96f564b35a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:33.948723 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e6e03ad7-38cd-426a-9dcd-1a96f564b35a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:33.950588 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e6e03ad7-38cd-426a-9dcd-1a96f564b35a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1281 microversion: 2.20 time: 0.134453 Jan 24 22:32:33.951683 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 403/784] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:33 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1281 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:32:33.979118 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d0bc182b-4f75-421d-b2de-6037254bfb71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:33.994755 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-d0bc182b-4f75-421d-b2de-6037254bfb71 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce" status: 200 len: 1319 microversion: 2.1 time: 0.318697 Jan 24 22:32:33.999529 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 382/785] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:33 2022] GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:34.226364 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-5f110ad3-8680-4310-908e-8eb9e6a69627 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'create', calling method: .version_select at 0x7f7e5d2075e0>, body: {"keypair": {"name": "tempest-keypair-230154008"}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:34.241361 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-5f110ad3-8680-4310-908e-8eb9e6a69627 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Getting quotas for project 971e5fb7e6884a74947db35700479fea. Resources: {'key_pairs'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:32:34.245271 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-5f110ad3-8680-4310-908e-8eb9e6a69627 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Getting quotas for user d96fc7e81114482c8149bb10fa4d6cf0 and project 971e5fb7e6884a74947db35700479fea. Resources: {'key_pairs'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:32:34.352224 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-5f110ad3-8680-4310-908e-8eb9e6a69627 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Getting quotas for project 971e5fb7e6884a74947db35700479fea. Resources: {'key_pairs'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:32:34.355974 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-5f110ad3-8680-4310-908e-8eb9e6a69627 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Getting quotas for user d96fc7e81114482c8149bb10fa4d6cf0 and project 971e5fb7e6884a74947db35700479fea. Resources: {'key_pairs'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:32:34.370491 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-5f110ad3-8680-4310-908e-8eb9e6a69627 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.148207 Jan 24 22:32:34.371309 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 404/786] 10.222.0.84 () {60 vars in 1157 bytes} [Mon Jan 24 22:32:34 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:32:34.969827 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-808ef81c-c901-44d4-8ea8-b170dc93404d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:34.970652 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-808ef81c-c901-44d4-8ea8-b170dc93404d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:34.977338 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-808ef81c-c901-44d4-8ea8-b170dc93404d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:34.977957 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-808ef81c-c901-44d4-8ea8-b170dc93404d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:34.978750 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-808ef81c-c901-44d4-8ea8-b170dc93404d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:34.979181 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-808ef81c-c901-44d4-8ea8-b170dc93404d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:35.019552 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-12196c9c-52eb-470a-9f2f-ea4552f449cf tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:35.020947 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-12196c9c-52eb-470a-9f2f-ea4552f449cf tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:35.032549 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-12196c9c-52eb-470a-9f2f-ea4552f449cf tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:35.036853 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-12196c9c-52eb-470a-9f2f-ea4552f449cf tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:35.037799 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-12196c9c-52eb-470a-9f2f-ea4552f449cf tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:35.038273 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-12196c9c-52eb-470a-9f2f-ea4552f449cf tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:35.113263 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-808ef81c-c901-44d4-8ea8-b170dc93404d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:35.121019 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-808ef81c-c901-44d4-8ea8-b170dc93404d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:35.122693 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-808ef81c-c901-44d4-8ea8-b170dc93404d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:35.123987 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-808ef81c-c901-44d4-8ea8-b170dc93404d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1333 microversion: 2.20 time: 0.158957 Jan 24 22:32:35.124531 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 383/787] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:34 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1333 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:32:35.403884 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-12196c9c-52eb-470a-9f2f-ea4552f449cf tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:35.420463 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-12196c9c-52eb-470a-9f2f-ea4552f449cf tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce" status: 200 len: 1507 microversion: 2.1 time: 0.406910 Jan 24 22:32:35.420463 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 405/788] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:35 2022] GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce => generated 1507 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:32:35.433492 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-69f56b4f-9f5f-4fd5-8276-11ceb37e60fa tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09ca3996-13c0-4517-940d-0b0c43d47b96", "device": "/dev/sdb"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:35.434567 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-69f56b4f-9f5f-4fd5-8276-11ceb37e60fa tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:35.440466 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-69f56b4f-9f5f-4fd5-8276-11ceb37e60fa tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:35.440917 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-69f56b4f-9f5f-4fd5-8276-11ceb37e60fa tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:35.441885 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-69f56b4f-9f5f-4fd5-8276-11ceb37e60fa tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:35.442309 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-69f56b4f-9f5f-4fd5-8276-11ceb37e60fa tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:35.758504 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-69f56b4f-9f5f-4fd5-8276-11ceb37e60fa tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "POST /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328464 Jan 24 22:32:35.759772 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 384/789] 10.222.0.84 () {60 vars in 1322 bytes} [Mon Jan 24 22:32:35 2022] POST /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:32:36.141959 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c078da1d-44f4-4dd4-985c-7b32dba1a948 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:36.143146 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c078da1d-44f4-4dd4-985c-7b32dba1a948 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:36.150891 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c078da1d-44f4-4dd4-985c-7b32dba1a948 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:36.151561 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c078da1d-44f4-4dd4-985c-7b32dba1a948 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:36.152598 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c078da1d-44f4-4dd4-985c-7b32dba1a948 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:36.153198 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c078da1d-44f4-4dd4-985c-7b32dba1a948 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:36.266195 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-c078da1d-44f4-4dd4-985c-7b32dba1a948 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:36.275069 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-c078da1d-44f4-4dd4-985c-7b32dba1a948 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:36.276653 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-c078da1d-44f4-4dd4-985c-7b32dba1a948 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:36.278083 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c078da1d-44f4-4dd4-985c-7b32dba1a948 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1339 microversion: 2.20 time: 0.139860 Jan 24 22:32:36.278686 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 406/790] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:36 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1339 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:32:36.747478 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c25ebf4b-7392-4ec5-8ff5-06d68de5f20a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1403293587", "imageRef": "4fe12948-6887-4759-900b-f3ee39409e75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6dcc1b10-df2b-4c1c-b91e-fb189e3895c8"}], "security_groups": [{"name": "tempest-securitygroup--1172583366"}], "key_name": "tempest-keypair-230154008", "user_data": "}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:36.918255 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.network.neutron [None req-c25ebf4b-7392-4ec5-8ff5-06d68de5f20a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] validate_networks() for [('6dcc1b10-df2b-4c1c-b91e-fb189e3895c8', None, None, None, None, None)] {{(pid=116466) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:32:37.297058 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-7b0193c7-dadc-4504-934c-bd75556bacf4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:37.297656 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-7b0193c7-dadc-4504-934c-bd75556bacf4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:37.304044 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7b0193c7-dadc-4504-934c-bd75556bacf4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:37.304445 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7b0193c7-dadc-4504-934c-bd75556bacf4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:37.305242 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7b0193c7-dadc-4504-934c-bd75556bacf4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:37.305929 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7b0193c7-dadc-4504-934c-bd75556bacf4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:37.726107 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7b0193c7-dadc-4504-934c-bd75556bacf4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:37.734959 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7b0193c7-dadc-4504-934c-bd75556bacf4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:37.735868 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-c25ebf4b-7392-4ec5-8ff5-06d68de5f20a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Flavor limits 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:32:37.736320 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-c25ebf4b-7392-4ec5-8ff5-06d68de5f20a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Image limits 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:32:37.736452 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7b0193c7-dadc-4504-934c-bd75556bacf4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:37.736780 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-c25ebf4b-7392-4ec5-8ff5-06d68de5f20a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Flavor pref 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:32:37.737196 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-c25ebf4b-7392-4ec5-8ff5-06d68de5f20a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Image pref 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:32:37.737765 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-7b0193c7-dadc-4504-934c-bd75556bacf4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1407 microversion: 2.20 time: 0.444431 Jan 24 22:32:37.737898 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-c25ebf4b-7392-4ec5-8ff5-06d68de5f20a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:32:37.738325 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 407/791] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:37 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:32:37.757217 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c25ebf4b-7392-4ec5-8ff5-06d68de5f20a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:37.757670 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c25ebf4b-7392-4ec5-8ff5-06d68de5f20a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:37.759010 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c25ebf4b-7392-4ec5-8ff5-06d68de5f20a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:37.759630 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c25ebf4b-7392-4ec5-8ff5-06d68de5f20a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:37.780417 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-c25ebf4b-7392-4ec5-8ff5-06d68de5f20a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Getting quotas for project 971e5fb7e6884a74947db35700479fea. Resources: {'cores', 'instances', 'ram'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:32:37.787749 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-c25ebf4b-7392-4ec5-8ff5-06d68de5f20a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Getting quotas for user d96fc7e81114482c8149bb10fa4d6cf0 and project 971e5fb7e6884a74947db35700479fea. Resources: {'cores', 'instances', 'ram'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:32:37.799912 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c25ebf4b-7392-4ec5-8ff5-06d68de5f20a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Going to run 1 instances... {{(pid=116466) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:32:37.802402 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c25ebf4b-7392-4ec5-8ff5-06d68de5f20a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4fe12948-6887-4759-900b-f3ee39409e75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:32:37.856532 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c25ebf4b-7392-4ec5-8ff5-06d68de5f20a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.114223 Jan 24 22:32:37.857265 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 385/792] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:32:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 24 22:32:37.867720 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c1fbcc0b-5df9-47ae-87f1-010cd93852f2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:37.868352 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c1fbcc0b-5df9-47ae-87f1-010cd93852f2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:37.957096 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-f8d2186d-bdc2-44a4-bf33-bdbaf9317035 req-2b5ef138-bc8d-4306-b63a-b5a1a4d0888c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6f4177-b89c-480a-a278-c470e82b9241", "tag": "b98d14cd-7266-457a-b737-02c742f241f8"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:37.958701 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:32:37.958701 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:32:37.981534 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-f8d2186d-bdc2-44a4-bf33-bdbaf9317035 req-2b5ef138-bc8d-4306-b63a-b5a1a4d0888c service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:37.982504 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-f8d2186d-bdc2-44a4-bf33-bdbaf9317035 req-2b5ef138-bc8d-4306-b63a-b5a1a4d0888c service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:37.984334 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-c1fbcc0b-5df9-47ae-87f1-010cd93852f2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:37.994761 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c1fbcc0b-5df9-47ae-87f1-010cd93852f2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1237 microversion: 2.1 time: 0.131094 Jan 24 22:32:38.006991 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-f8d2186d-bdc2-44a4-bf33-bdbaf9317035 req-2b5ef138-bc8d-4306-b63a-b5a1a4d0888c service nova] Creating event network-changed:b98d14cd-7266-457a-b737-02c742f241f8 for instance ee6f4177-b89c-480a-a278-c470e82b9241 on hv-cinder-81322 Jan 24 22:32:38.015942 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-f8d2186d-bdc2-44a4-bf33-bdbaf9317035 req-2b5ef138-bc8d-4306-b63a-b5a1a4d0888c service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065252 Jan 24 22:32:38.020469 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 408/793] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:37 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1237 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:38.020899 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 386/794] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:32:38.755705 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-03518d81-7e2f-42d5-bddb-fd4d9d6975dc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:38.756360 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-03518d81-7e2f-42d5-bddb-fd4d9d6975dc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:38.763414 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-03518d81-7e2f-42d5-bddb-fd4d9d6975dc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:38.764163 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-03518d81-7e2f-42d5-bddb-fd4d9d6975dc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:38.765493 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-03518d81-7e2f-42d5-bddb-fd4d9d6975dc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:38.766177 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-03518d81-7e2f-42d5-bddb-fd4d9d6975dc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:38.997887 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-03518d81-7e2f-42d5-bddb-fd4d9d6975dc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:39.005878 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-03518d81-7e2f-42d5-bddb-fd4d9d6975dc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:39.007359 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-03518d81-7e2f-42d5-bddb-fd4d9d6975dc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:39.008450 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-03518d81-7e2f-42d5-bddb-fd4d9d6975dc tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1407 microversion: 2.20 time: 0.256550 Jan 24 22:32:39.009391 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 409/795] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:38 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:32:39.014495 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-d04d5e8f-9756-4057-9c78-814b747cba18 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:39.015526 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d04d5e8f-9756-4057-9c78-814b747cba18 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:39.021951 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d04d5e8f-9756-4057-9c78-814b747cba18 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:39.022392 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d04d5e8f-9756-4057-9c78-814b747cba18 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:39.023187 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d04d5e8f-9756-4057-9c78-814b747cba18 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:39.023645 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d04d5e8f-9756-4057-9c78-814b747cba18 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:39.111445 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d04d5e8f-9756-4057-9c78-814b747cba18 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:39.119879 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-d04d5e8f-9756-4057-9c78-814b747cba18 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1289 microversion: 2.1 time: 0.109900 Jan 24 22:32:39.120670 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 387/796] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:39 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1289 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:40.026814 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e86c2edd-78e3-4c88-a780-ac744a29105c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:40.028333 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e86c2edd-78e3-4c88-a780-ac744a29105c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:40.034971 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e86c2edd-78e3-4c88-a780-ac744a29105c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:40.035565 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e86c2edd-78e3-4c88-a780-ac744a29105c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:40.036369 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e86c2edd-78e3-4c88-a780-ac744a29105c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:40.036794 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e86c2edd-78e3-4c88-a780-ac744a29105c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:40.139065 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a9b1bc1a-7ae5-4a5a-8023-5267402c26ba tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:40.141637 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a9b1bc1a-7ae5-4a5a-8023-5267402c26ba tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:40.149115 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a9b1bc1a-7ae5-4a5a-8023-5267402c26ba tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:40.154487 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a9b1bc1a-7ae5-4a5a-8023-5267402c26ba tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:40.159329 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a9b1bc1a-7ae5-4a5a-8023-5267402c26ba tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:40.160248 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a9b1bc1a-7ae5-4a5a-8023-5267402c26ba tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:40.190655 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e86c2edd-78e3-4c88-a780-ac744a29105c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:40.199407 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e86c2edd-78e3-4c88-a780-ac744a29105c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:40.200888 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e86c2edd-78e3-4c88-a780-ac744a29105c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:40.202480 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e86c2edd-78e3-4c88-a780-ac744a29105c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1407 microversion: 2.20 time: 0.179993 Jan 24 22:32:40.203032 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 410/797] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:40 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:32:40.309305 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a9b1bc1a-7ae5-4a5a-8023-5267402c26ba tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:40.316773 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a9b1bc1a-7ae5-4a5a-8023-5267402c26ba tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1363 microversion: 2.1 time: 0.183004 Jan 24 22:32:40.317376 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 388/798] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:40 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:40.667140 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-bd78a951-3232-4dd9-9986-44427750be7f req-2a4da474-059a-426e-b648-e96323411859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d98aba3-4e1a-4acd-9aff-582acd7e2322", "tag": "2224cb8d-9ba5-46c9-9ad0-f349156ad1fb"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:40.668833 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:32:40.668833 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:32:40.682791 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-bd78a951-3232-4dd9-9986-44427750be7f req-2a4da474-059a-426e-b648-e96323411859 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:40.683234 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-bd78a951-3232-4dd9-9986-44427750be7f req-2a4da474-059a-426e-b648-e96323411859 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:40.695988 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-bd78a951-3232-4dd9-9986-44427750be7f req-2a4da474-059a-426e-b648-e96323411859 service nova] Creating event network-changed:2224cb8d-9ba5-46c9-9ad0-f349156ad1fb for instance 4d98aba3-4e1a-4acd-9aff-582acd7e2322 on hv-cinder-81322 Jan 24 22:32:40.703078 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-bd78a951-3232-4dd9-9986-44427750be7f req-2a4da474-059a-426e-b648-e96323411859 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039017 Jan 24 22:32:40.703940 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 411/799] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:32:41.226681 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a00f9ba5-7642-4812-9c7a-ea989257feed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:41.228175 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a00f9ba5-7642-4812-9c7a-ea989257feed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:41.246643 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a00f9ba5-7642-4812-9c7a-ea989257feed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:41.247098 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a00f9ba5-7642-4812-9c7a-ea989257feed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:41.248147 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a00f9ba5-7642-4812-9c7a-ea989257feed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:41.248579 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a00f9ba5-7642-4812-9c7a-ea989257feed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:41.335563 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4e8ef769-731f-4ff5-9eac-b6577aefaae0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:41.337112 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4e8ef769-731f-4ff5-9eac-b6577aefaae0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:41.344762 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4e8ef769-731f-4ff5-9eac-b6577aefaae0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:41.345971 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4e8ef769-731f-4ff5-9eac-b6577aefaae0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:41.347252 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4e8ef769-731f-4ff5-9eac-b6577aefaae0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:41.348054 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4e8ef769-731f-4ff5-9eac-b6577aefaae0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:41.450982 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a00f9ba5-7642-4812-9c7a-ea989257feed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:41.469289 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a00f9ba5-7642-4812-9c7a-ea989257feed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:41.473192 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a00f9ba5-7642-4812-9c7a-ea989257feed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:41.473192 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a00f9ba5-7642-4812-9c7a-ea989257feed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1407 microversion: 2.20 time: 0.255921 Jan 24 22:32:41.482406 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 389/800] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:41 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:32:41.541710 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4e8ef769-731f-4ff5-9eac-b6577aefaae0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:41.551010 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4e8ef769-731f-4ff5-9eac-b6577aefaae0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1363 microversion: 2.1 time: 0.221241 Jan 24 22:32:41.552234 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 412/801] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:41 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:42.490298 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-789b93a7-6a4c-4067-90d7-082d19b97dcb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:42.490898 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-789b93a7-6a4c-4067-90d7-082d19b97dcb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:42.497916 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-789b93a7-6a4c-4067-90d7-082d19b97dcb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:42.498578 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-789b93a7-6a4c-4067-90d7-082d19b97dcb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:42.499650 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-789b93a7-6a4c-4067-90d7-082d19b97dcb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:42.500237 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-789b93a7-6a4c-4067-90d7-082d19b97dcb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:42.569163 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-cc1c4d49-7104-44cb-9782-b5cd9f675915 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:42.570399 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-cc1c4d49-7104-44cb-9782-b5cd9f675915 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:42.577824 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cc1c4d49-7104-44cb-9782-b5cd9f675915 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:42.578555 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cc1c4d49-7104-44cb-9782-b5cd9f675915 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:42.579832 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cc1c4d49-7104-44cb-9782-b5cd9f675915 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:42.580174 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cc1c4d49-7104-44cb-9782-b5cd9f675915 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:42.766328 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-789b93a7-6a4c-4067-90d7-082d19b97dcb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:42.775351 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-789b93a7-6a4c-4067-90d7-082d19b97dcb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:42.777265 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-789b93a7-6a4c-4067-90d7-082d19b97dcb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:42.778646 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-789b93a7-6a4c-4067-90d7-082d19b97dcb tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1407 microversion: 2.20 time: 0.292409 Jan 24 22:32:42.779372 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 390/802] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:42 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1407 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:32:42.827797 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-cc1c4d49-7104-44cb-9782-b5cd9f675915 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:42.837749 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-cc1c4d49-7104-44cb-9782-b5cd9f675915 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1363 microversion: 2.1 time: 0.272179 Jan 24 22:32:42.852485 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 413/803] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:42 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:43.186415 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-bd4e289c-ab04-4ee0-88fb-15041d953724 req-7403796e-45ee-4c16-9e99-16235e949dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6f4177-b89c-480a-a278-c470e82b9241", "name": "network-vif-plugged", "status": "completed", "tag": "b98d14cd-7266-457a-b737-02c742f241f8"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:43.188143 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:32:43.188143 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:32:43.195694 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-bd4e289c-ab04-4ee0-88fb-15041d953724 req-7403796e-45ee-4c16-9e99-16235e949dec service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:43.196236 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-bd4e289c-ab04-4ee0-88fb-15041d953724 req-7403796e-45ee-4c16-9e99-16235e949dec service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:43.208755 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-bd4e289c-ab04-4ee0-88fb-15041d953724 req-7403796e-45ee-4c16-9e99-16235e949dec service nova] Creating event network-vif-plugged:b98d14cd-7266-457a-b737-02c742f241f8 for instance ee6f4177-b89c-480a-a278-c470e82b9241 on hv-cinder-81322 Jan 24 22:32:43.215853 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-bd4e289c-ab04-4ee0-88fb-15041d953724 req-7403796e-45ee-4c16-9e99-16235e949dec service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032957 Jan 24 22:32:43.218493 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 391/804] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:32:43.798251 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6bde2af5-9f77-4aeb-856a-b759315ff448 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:43.798906 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6bde2af5-9f77-4aeb-856a-b759315ff448 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:43.806270 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6bde2af5-9f77-4aeb-856a-b759315ff448 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:43.806808 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6bde2af5-9f77-4aeb-856a-b759315ff448 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:43.807562 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6bde2af5-9f77-4aeb-856a-b759315ff448 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:43.808009 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6bde2af5-9f77-4aeb-856a-b759315ff448 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:43.856665 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-31c6041c-14c5-407e-9eeb-5cdee3f4c08a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:43.857356 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-31c6041c-14c5-407e-9eeb-5cdee3f4c08a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:43.871893 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-31c6041c-14c5-407e-9eeb-5cdee3f4c08a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:43.872348 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-31c6041c-14c5-407e-9eeb-5cdee3f4c08a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:43.873185 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-31c6041c-14c5-407e-9eeb-5cdee3f4c08a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:43.874312 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-31c6041c-14c5-407e-9eeb-5cdee3f4c08a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:44.000790 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6bde2af5-9f77-4aeb-856a-b759315ff448 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:44.012488 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6bde2af5-9f77-4aeb-856a-b759315ff448 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:44.014083 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6bde2af5-9f77-4aeb-856a-b759315ff448 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:44.015310 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6bde2af5-9f77-4aeb-856a-b759315ff448 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1407 microversion: 2.20 time: 0.221497 Jan 24 22:32:44.016304 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 414/805] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:43 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:32:44.064577 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-31c6041c-14c5-407e-9eeb-5cdee3f4c08a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:44.072637 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-31c6041c-14c5-407e-9eeb-5cdee3f4c08a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1363 microversion: 2.1 time: 0.220273 Jan 24 22:32:44.073424 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 392/806] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:43 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:45.036467 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-fc13f15d-b5de-4274-bb43-95c40d4831dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:45.039486 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-fc13f15d-b5de-4274-bb43-95c40d4831dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:45.053312 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fc13f15d-b5de-4274-bb43-95c40d4831dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:45.053808 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fc13f15d-b5de-4274-bb43-95c40d4831dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:45.054825 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fc13f15d-b5de-4274-bb43-95c40d4831dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:45.055410 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fc13f15d-b5de-4274-bb43-95c40d4831dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:45.092046 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-d779f9f0-9c5d-4e73-8a31-0a2e0fef332a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:45.093764 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d779f9f0-9c5d-4e73-8a31-0a2e0fef332a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:45.103324 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d779f9f0-9c5d-4e73-8a31-0a2e0fef332a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:45.104195 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d779f9f0-9c5d-4e73-8a31-0a2e0fef332a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:45.105793 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d779f9f0-9c5d-4e73-8a31-0a2e0fef332a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:45.106672 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d779f9f0-9c5d-4e73-8a31-0a2e0fef332a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:45.368453 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-fc13f15d-b5de-4274-bb43-95c40d4831dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:45.372816 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d779f9f0-9c5d-4e73-8a31-0a2e0fef332a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:45.377664 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-fc13f15d-b5de-4274-bb43-95c40d4831dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:45.379628 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-fc13f15d-b5de-4274-bb43-95c40d4831dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:45.381504 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-d779f9f0-9c5d-4e73-8a31-0a2e0fef332a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1363 microversion: 2.1 time: 0.295809 Jan 24 22:32:45.381657 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-fc13f15d-b5de-4274-bb43-95c40d4831dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1407 microversion: 2.20 time: 0.352017 Jan 24 22:32:45.382672 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 415/807] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:45 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:32:45.385310 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 393/808] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:45 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:32:46.398626 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-8982f967-eadf-4db5-a857-36456738ec40 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:46.399245 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-8982f967-eadf-4db5-a857-36456738ec40 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:46.399401 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-09393184-0f43-49cd-b5f5-892ea6d17bb3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:46.400525 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-09393184-0f43-49cd-b5f5-892ea6d17bb3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:46.406584 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8982f967-eadf-4db5-a857-36456738ec40 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:46.407025 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8982f967-eadf-4db5-a857-36456738ec40 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:46.407569 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-09393184-0f43-49cd-b5f5-892ea6d17bb3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:46.407800 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8982f967-eadf-4db5-a857-36456738ec40 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:46.408199 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-09393184-0f43-49cd-b5f5-892ea6d17bb3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:46.408298 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8982f967-eadf-4db5-a857-36456738ec40 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:46.409177 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-09393184-0f43-49cd-b5f5-892ea6d17bb3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:46.409876 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-09393184-0f43-49cd-b5f5-892ea6d17bb3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:46.618984 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-8982f967-eadf-4db5-a857-36456738ec40 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:46.628857 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-8982f967-eadf-4db5-a857-36456738ec40 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1363 microversion: 2.1 time: 0.233762 Jan 24 22:32:46.629999 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 416/809] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:46 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:46.648011 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-09393184-0f43-49cd-b5f5-892ea6d17bb3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:46.656335 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-09393184-0f43-49cd-b5f5-892ea6d17bb3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:46.659202 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-09393184-0f43-49cd-b5f5-892ea6d17bb3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:46.660553 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-09393184-0f43-49cd-b5f5-892ea6d17bb3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1407 microversion: 2.20 time: 0.265029 Jan 24 22:32:46.671608 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 394/810] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:46 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:32:47.647884 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b5cae3f5-84fd-442e-9fe9-55f0c88555c0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:47.648608 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b5cae3f5-84fd-442e-9fe9-55f0c88555c0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:47.656457 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b5cae3f5-84fd-442e-9fe9-55f0c88555c0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:47.656958 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b5cae3f5-84fd-442e-9fe9-55f0c88555c0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:47.657718 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b5cae3f5-84fd-442e-9fe9-55f0c88555c0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:47.658162 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b5cae3f5-84fd-442e-9fe9-55f0c88555c0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:47.678727 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e1efee0c-6d5d-44e5-b2a9-f85d9a64991f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:47.683290 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e1efee0c-6d5d-44e5-b2a9-f85d9a64991f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:47.692192 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e1efee0c-6d5d-44e5-b2a9-f85d9a64991f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:47.692934 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e1efee0c-6d5d-44e5-b2a9-f85d9a64991f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:47.693991 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e1efee0c-6d5d-44e5-b2a9-f85d9a64991f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:47.694542 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e1efee0c-6d5d-44e5-b2a9-f85d9a64991f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:48.315077 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e1efee0c-6d5d-44e5-b2a9-f85d9a64991f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:48.321609 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b5cae3f5-84fd-442e-9fe9-55f0c88555c0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:48.323666 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e1efee0c-6d5d-44e5-b2a9-f85d9a64991f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:48.325203 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e1efee0c-6d5d-44e5-b2a9-f85d9a64991f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:48.326482 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e1efee0c-6d5d-44e5-b2a9-f85d9a64991f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1407 microversion: 2.20 time: 0.651522 Jan 24 22:32:48.331205 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b5cae3f5-84fd-442e-9fe9-55f0c88555c0 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1363 microversion: 2.1 time: 0.687593 Jan 24 22:32:48.331873 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 417/812] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:47 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1363 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:48.337696 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 395/812] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:47 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1407 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:32:49.344972 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a0703c15-3ac9-41a8-a4dd-2fcfca8a5209 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:49.346234 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a0703c15-3ac9-41a8-a4dd-2fcfca8a5209 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:49.371784 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-63ffb9d3-dedd-42fa-bc01-7f24cc935942 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:49.372577 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-63ffb9d3-dedd-42fa-bc01-7f24cc935942 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:49.392996 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-63ffb9d3-dedd-42fa-bc01-7f24cc935942 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:49.393284 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a0703c15-3ac9-41a8-a4dd-2fcfca8a5209 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:49.393882 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a0703c15-3ac9-41a8-a4dd-2fcfca8a5209 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:49.395778 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-63ffb9d3-dedd-42fa-bc01-7f24cc935942 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:49.396450 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a0703c15-3ac9-41a8-a4dd-2fcfca8a5209 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:49.396903 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a0703c15-3ac9-41a8-a4dd-2fcfca8a5209 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:49.398684 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-63ffb9d3-dedd-42fa-bc01-7f24cc935942 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:49.400797 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-63ffb9d3-dedd-42fa-bc01-7f24cc935942 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:49.670165 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-63ffb9d3-dedd-42fa-bc01-7f24cc935942 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:49.680041 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-63ffb9d3-dedd-42fa-bc01-7f24cc935942 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1363 microversion: 2.1 time: 0.335682 Jan 24 22:32:49.695406 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 396/813] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:49 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:49.731516 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a0703c15-3ac9-41a8-a4dd-2fcfca8a5209 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:49.740422 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a0703c15-3ac9-41a8-a4dd-2fcfca8a5209 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:49.742066 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a0703c15-3ac9-41a8-a4dd-2fcfca8a5209 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:49.743402 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a0703c15-3ac9-41a8-a4dd-2fcfca8a5209 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1600 microversion: 2.20 time: 0.402815 Jan 24 22:32:49.744686 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 418/814] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:32:49 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1600 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:32:49.762300 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-d4d7c865-6fe9-408d-847b-44c10eba76e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:49.763182 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d4d7c865-6fe9-408d-847b-44c10eba76e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:49.771048 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d4d7c865-6fe9-408d-847b-44c10eba76e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:49.771494 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d4d7c865-6fe9-408d-847b-44c10eba76e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:49.772273 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d4d7c865-6fe9-408d-847b-44c10eba76e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:49.772698 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d4d7c865-6fe9-408d-847b-44c10eba76e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:49.886479 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-d4d7c865-6fe9-408d-847b-44c10eba76e6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.128241 Jan 24 22:32:49.887674 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 397/815] 10.222.0.84 () {60 vars in 1315 bytes} [Mon Jan 24 22:32:49 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:32:50.282973 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-7432114f-33a8-4622-854b-105254a5f20a req-3326ad2e-b40f-49e6-855a-f93f8064dd32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d98aba3-4e1a-4acd-9aff-582acd7e2322", "name": "network-vif-plugged", "status": "completed", "tag": "2224cb8d-9ba5-46c9-9ad0-f349156ad1fb"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:50.284677 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:32:50.284677 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:32:50.305191 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-7432114f-33a8-4622-854b-105254a5f20a req-3326ad2e-b40f-49e6-855a-f93f8064dd32 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:50.305708 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-7432114f-33a8-4622-854b-105254a5f20a req-3326ad2e-b40f-49e6-855a-f93f8064dd32 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:50.328106 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-7432114f-33a8-4622-854b-105254a5f20a req-3326ad2e-b40f-49e6-855a-f93f8064dd32 service nova] Creating event network-vif-plugged:2224cb8d-9ba5-46c9-9ad0-f349156ad1fb for instance 4d98aba3-4e1a-4acd-9aff-582acd7e2322 on hv-cinder-81322 Jan 24 22:32:50.344447 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-7432114f-33a8-4622-854b-105254a5f20a req-3326ad2e-b40f-49e6-855a-f93f8064dd32 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065230 Jan 24 22:32:50.347896 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 419/816] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:32:50.697243 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-eeafb753-f6a2-4526-a2d5-e57a9f5298bd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:50.698723 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-eeafb753-f6a2-4526-a2d5-e57a9f5298bd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:50.710342 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-eeafb753-f6a2-4526-a2d5-e57a9f5298bd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:50.712586 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-eeafb753-f6a2-4526-a2d5-e57a9f5298bd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:50.727720 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-eeafb753-f6a2-4526-a2d5-e57a9f5298bd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:50.728235 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-eeafb753-f6a2-4526-a2d5-e57a9f5298bd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:50.995833 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-eeafb753-f6a2-4526-a2d5-e57a9f5298bd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:51.020137 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-eeafb753-f6a2-4526-a2d5-e57a9f5298bd tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1363 microversion: 2.1 time: 0.323386 Jan 24 22:32:51.021370 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 398/817] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:50 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:51.596906 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e6fddd8f-3a67-45f8-89e4-09c959c92860 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:51.598508 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e6fddd8f-3a67-45f8-89e4-09c959c92860 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:51.601347 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-090e72d4-6df7-4a15-aa2a-d5a03836824a req-fcc76154-c55d-400c-ae51-fe91d48fe703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6f4177-b89c-480a-a278-c470e82b9241", "tag": "b98d14cd-7266-457a-b737-02c742f241f8"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:51.603625 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:32:51.603625 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:32:51.607045 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e6fddd8f-3a67-45f8-89e4-09c959c92860 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:51.610120 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e6fddd8f-3a67-45f8-89e4-09c959c92860 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:51.613507 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-090e72d4-6df7-4a15-aa2a-d5a03836824a req-fcc76154-c55d-400c-ae51-fe91d48fe703 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:51.613690 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e6fddd8f-3a67-45f8-89e4-09c959c92860 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:51.614319 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-090e72d4-6df7-4a15-aa2a-d5a03836824a req-fcc76154-c55d-400c-ae51-fe91d48fe703 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:51.615885 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e6fddd8f-3a67-45f8-89e4-09c959c92860 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:51.630674 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-090e72d4-6df7-4a15-aa2a-d5a03836824a req-fcc76154-c55d-400c-ae51-fe91d48fe703 service nova] Creating event network-changed:b98d14cd-7266-457a-b737-02c742f241f8 for instance ee6f4177-b89c-480a-a278-c470e82b9241 on hv-cinder-81322 Jan 24 22:32:51.637698 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-090e72d4-6df7-4a15-aa2a-d5a03836824a req-fcc76154-c55d-400c-ae51-fe91d48fe703 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040433 Jan 24 22:32:51.648386 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 399/818] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:32:52.044447 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8569e94c-23cf-4c85-91ec-9c6788d2371d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:52.046638 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8569e94c-23cf-4c85-91ec-9c6788d2371d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:52.057133 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8569e94c-23cf-4c85-91ec-9c6788d2371d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:52.058018 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8569e94c-23cf-4c85-91ec-9c6788d2371d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:52.059187 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8569e94c-23cf-4c85-91ec-9c6788d2371d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:52.059955 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8569e94c-23cf-4c85-91ec-9c6788d2371d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:52.282569 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-8569e94c-23cf-4c85-91ec-9c6788d2371d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:52.294945 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8569e94c-23cf-4c85-91ec-9c6788d2371d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1363 microversion: 2.1 time: 0.257323 Jan 24 22:32:52.295704 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 400/819] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:52 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:53.321986 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-cfcc57c6-156a-4126-a438-691e653f08ea tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Action: 'create', calling method: .version_select at 0x7f7e5d178430>, body: {"keypair": {"name": "tempest-TestShelveInstance-829940236"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:53.336761 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-cfcc57c6-156a-4126-a438-691e653f08ea tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Getting quotas for project 63897275a7664529bc1d568ba2f36b15. Resources: {'key_pairs'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:32:53.343912 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-cfcc57c6-156a-4126-a438-691e653f08ea tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Getting quotas for user f1ef8bba622344a4bdb1b08532943f48 and project 63897275a7664529bc1d568ba2f36b15. Resources: {'key_pairs'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:32:53.463185 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-cfcc57c6-156a-4126-a438-691e653f08ea tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Getting quotas for project 63897275a7664529bc1d568ba2f36b15. Resources: {'key_pairs'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:32:53.467616 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-cfcc57c6-156a-4126-a438-691e653f08ea tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Getting quotas for user f1ef8bba622344a4bdb1b08532943f48 and project 63897275a7664529bc1d568ba2f36b15. Resources: {'key_pairs'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:32:53.482238 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-cfcc57c6-156a-4126-a438-691e653f08ea tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.275269 Jan 24 22:32:53.482853 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 401/820] 10.222.0.84 () {60 vars in 1157 bytes} [Mon Jan 24 22:32:53 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:53.489679 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-5977bb26-76c8-4b69-b4d6-d2b88ba20da9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:53.489679 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-5977bb26-76c8-4b69-b4d6-d2b88ba20da9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:53.494829 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5977bb26-76c8-4b69-b4d6-d2b88ba20da9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:53.496048 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5977bb26-76c8-4b69-b4d6-d2b88ba20da9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:53.496876 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5977bb26-76c8-4b69-b4d6-d2b88ba20da9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:53.497351 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5977bb26-76c8-4b69-b4d6-d2b88ba20da9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:53.641008 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-5977bb26-76c8-4b69-b4d6-d2b88ba20da9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:53.649328 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-5977bb26-76c8-4b69-b4d6-d2b88ba20da9 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1363 microversion: 2.1 time: 0.165351 Jan 24 22:32:53.650299 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 402/821] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:53 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:53.774438 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e6fddd8f-3a67-45f8-89e4-09c959c92860 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 14 microversion: 2.20 time: 2.182161 Jan 24 22:32:53.775931 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 420/822] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:32:51 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 14 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:54.666721 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-825d8da6-5b62-43ae-89f6-1253879965fb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:54.667166 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-825d8da6-5b62-43ae-89f6-1253879965fb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:54.678953 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-825d8da6-5b62-43ae-89f6-1253879965fb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:54.678953 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-825d8da6-5b62-43ae-89f6-1253879965fb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:54.679873 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-825d8da6-5b62-43ae-89f6-1253879965fb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:54.680322 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-825d8da6-5b62-43ae-89f6-1253879965fb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:54.787843 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9b338ac3-50ff-400b-89b2-ecb912cd34a3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:54.789786 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9b338ac3-50ff-400b-89b2-ecb912cd34a3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:54.804285 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9b338ac3-50ff-400b-89b2-ecb912cd34a3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:54.805141 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9b338ac3-50ff-400b-89b2-ecb912cd34a3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:54.807172 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9b338ac3-50ff-400b-89b2-ecb912cd34a3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:54.826090 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9b338ac3-50ff-400b-89b2-ecb912cd34a3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:54.852231 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-825d8da6-5b62-43ae-89f6-1253879965fb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:54.864172 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-825d8da6-5b62-43ae-89f6-1253879965fb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1363 microversion: 2.1 time: 0.201324 Jan 24 22:32:54.869048 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 403/823] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:54 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:54.955613 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9b338ac3-50ff-400b-89b2-ecb912cd34a3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 14 microversion: 2.20 time: 0.172014 Jan 24 22:32:54.956290 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 421/824] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:32:54 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:55.883422 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-69ed99c1-3643-453b-a4d5-df58a4663910 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:55.884272 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-69ed99c1-3643-453b-a4d5-df58a4663910 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:55.892080 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-69ed99c1-3643-453b-a4d5-df58a4663910 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:55.892876 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-69ed99c1-3643-453b-a4d5-df58a4663910 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:55.893966 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-69ed99c1-3643-453b-a4d5-df58a4663910 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:55.894441 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-69ed99c1-3643-453b-a4d5-df58a4663910 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:55.972130 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9ee9839a-4a6b-4475-a323-8beb750b6d44 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:55.972130 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9ee9839a-4a6b-4475-a323-8beb750b6d44 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:55.985405 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9ee9839a-4a6b-4475-a323-8beb750b6d44 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:55.985958 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9ee9839a-4a6b-4475-a323-8beb750b6d44 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:55.986965 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9ee9839a-4a6b-4475-a323-8beb750b6d44 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:55.987373 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9ee9839a-4a6b-4475-a323-8beb750b6d44 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:56.058992 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-69ed99c1-3643-453b-a4d5-df58a4663910 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:32:56.073866 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-69ed99c1-3643-453b-a4d5-df58a4663910 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1550 microversion: 2.1 time: 0.195642 Jan 24 22:32:56.074891 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 404/825] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:32:55 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1550 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:56.079848 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9ee9839a-4a6b-4475-a323-8beb750b6d44 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 14 microversion: 2.20 time: 0.116263 Jan 24 22:32:56.081136 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 422/826] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:32:55 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:56.090430 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c12b4993-f008-4769-8d29-eef0a236b946 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:56.090855 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c12b4993-f008-4769-8d29-eef0a236b946 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:56.096869 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c12b4993-f008-4769-8d29-eef0a236b946 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:56.097478 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c12b4993-f008-4769-8d29-eef0a236b946 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:56.098292 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c12b4993-f008-4769-8d29-eef0a236b946 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:56.098721 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c12b4993-f008-4769-8d29-eef0a236b946 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:56.179549 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c12b4993-f008-4769-8d29-eef0a236b946 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092737 Jan 24 22:32:56.180234 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 405/827] 10.222.0.84 () {58 vars in 1274 bytes} [Mon Jan 24 22:32:56 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:32:57.091208 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-75c1658c-5053-4385-be55-2de3ed6d5397 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:57.092442 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-75c1658c-5053-4385-be55-2de3ed6d5397 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:57.104596 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-75c1658c-5053-4385-be55-2de3ed6d5397 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:57.107245 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-75c1658c-5053-4385-be55-2de3ed6d5397 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:57.112752 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-75c1658c-5053-4385-be55-2de3ed6d5397 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:57.113440 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-75c1658c-5053-4385-be55-2de3ed6d5397 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:57.240808 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-75c1658c-5053-4385-be55-2de3ed6d5397 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 14 microversion: 2.20 time: 0.153616 Jan 24 22:32:57.244370 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 423/828] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:32:57 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:32:57.474382 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-4d8dfca6-09b5-4e03-8dcc-a330c5d8a984 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:32:57.475488 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-4d8dfca6-09b5-4e03-8dcc-a330c5d8a984 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:57.485256 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4d8dfca6-09b5-4e03-8dcc-a330c5d8a984 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:57.485987 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4d8dfca6-09b5-4e03-8dcc-a330c5d8a984 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:57.492383 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4d8dfca6-09b5-4e03-8dcc-a330c5d8a984 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:57.493304 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4d8dfca6-09b5-4e03-8dcc-a330c5d8a984 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:57.579174 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.objects.instance [None req-4d8dfca6-09b5-4e03-8dcc-a330c5d8a984 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lazy-loading 'services' on Instance uuid 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce {{(pid=116466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:32:57.644929 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-55a30978-0271-4af1-97c6-2a4f9c49d5eb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:57.646088 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-55a30978-0271-4af1-97c6-2a4f9c49d5eb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:57.653710 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-55a30978-0271-4af1-97c6-2a4f9c49d5eb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:57.654632 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-55a30978-0271-4af1-97c6-2a4f9c49d5eb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:57.655654 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-55a30978-0271-4af1-97c6-2a4f9c49d5eb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:57.656285 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-55a30978-0271-4af1-97c6-2a4f9c49d5eb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:57.673510 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-4d8dfca6-09b5-4e03-8dcc-a330c5d8a984 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "DELETE /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce/os-volume_attachments/09ca3996-13c0-4517-940d-0b0c43d47b96" status: 202 len: 0 microversion: 2.1 time: 0.203626 Jan 24 22:32:57.674812 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 406/829] 10.222.0.84 () {58 vars in 1415 bytes} [Mon Jan 24 22:32:57 2022] DELETE /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce/os-volume_attachments/09ca3996-13c0-4517-940d-0b0c43d47b96 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:32:57.705847 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-9ad3db22-4fcd-4e04-a878-6d7bbe4581f3 req-3e32419a-195b-4fa9-bc1d-d043e164039f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d98aba3-4e1a-4acd-9aff-582acd7e2322", "tag": "2224cb8d-9ba5-46c9-9ad0-f349156ad1fb"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:57.709515 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:32:57.709515 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:32:57.722934 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-9ad3db22-4fcd-4e04-a878-6d7bbe4581f3 req-3e32419a-195b-4fa9-bc1d-d043e164039f service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:57.723464 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-9ad3db22-4fcd-4e04-a878-6d7bbe4581f3 req-3e32419a-195b-4fa9-bc1d-d043e164039f service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:57.749864 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-9ad3db22-4fcd-4e04-a878-6d7bbe4581f3 req-3e32419a-195b-4fa9-bc1d-d043e164039f service nova] Creating event network-changed:2224cb8d-9ba5-46c9-9ad0-f349156ad1fb for instance 4d98aba3-4e1a-4acd-9aff-582acd7e2322 on hv-cinder-81322 Jan 24 22:32:57.756408 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-9ad3db22-4fcd-4e04-a878-6d7bbe4581f3 req-3e32419a-195b-4fa9-bc1d-d043e164039f service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079371 Jan 24 22:32:57.758239 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 407/830] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:32:57.817010 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-55a30978-0271-4af1-97c6-2a4f9c49d5eb tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 14 microversion: 2.1 time: 0.176256 Jan 24 22:32:57.817778 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 424/831] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:32:57 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 22:32:58.253553 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-02bbfe05-02ba-4826-bb1e-ee3a672365c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:58.254754 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-02bbfe05-02ba-4826-bb1e-ee3a672365c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:58.263913 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-02bbfe05-02ba-4826-bb1e-ee3a672365c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:58.265143 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-02bbfe05-02ba-4826-bb1e-ee3a672365c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:58.266345 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-02bbfe05-02ba-4826-bb1e-ee3a672365c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:58.266975 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-02bbfe05-02ba-4826-bb1e-ee3a672365c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:58.828583 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c1218e43-b3fe-416f-9871-15f06e9fd489 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:32:58.832617 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c1218e43-b3fe-416f-9871-15f06e9fd489 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:32:58.839931 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c1218e43-b3fe-416f-9871-15f06e9fd489 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:58.840383 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c1218e43-b3fe-416f-9871-15f06e9fd489 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:32:58.841299 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c1218e43-b3fe-416f-9871-15f06e9fd489 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:32:58.841591 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c1218e43-b3fe-416f-9871-15f06e9fd489 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:12.028491 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c1218e43-b3fe-416f-9871-15f06e9fd489 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 18498 microversion: 2.1 time: 13.203749 Jan 24 22:33:12.029647 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 425/832] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:32:58 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 18498 bytes in 13206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:12.035757 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6188e865-3b84-4750-9cba-646642ca0657 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1461749151", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-829940236", "security_groups": [{"name": "tempest-secgroup-smoke-1141713896"}], "networks": [{"uuid": "1f3c7338-6ac6-467e-ba3e-0040076ea594"}], "block_device_mapping_v2": [{"uuid": "5fd815bf-781c-4d38-aacc-7ca5a444a6dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:12.054359 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-02bbfe05-02ba-4826-bb1e-ee3a672365c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 23801 microversion: 2.20 time: 13.805175 Jan 24 22:33:12.058876 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 408/833] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:32:58 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 23801 bytes in 13808 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:12.249383 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.network.neutron [None req-6188e865-3b84-4750-9cba-646642ca0657 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] validate_networks() for [('1f3c7338-6ac6-467e-ba3e-0040076ea594', None, None, None, None, None)] {{(pid=116467) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:33:12.955210 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-6188e865-3b84-4750-9cba-646642ca0657 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Flavor limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:33:12.955770 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-6188e865-3b84-4750-9cba-646642ca0657 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Image limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:33:12.956305 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-6188e865-3b84-4750-9cba-646642ca0657 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Flavor pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:33:12.956948 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-6188e865-3b84-4750-9cba-646642ca0657 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Image pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:33:12.957447 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-6188e865-3b84-4750-9cba-646642ca0657 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:33:12.968703 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6188e865-3b84-4750-9cba-646642ca0657 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:12.969534 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6188e865-3b84-4750-9cba-646642ca0657 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:12.970406 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6188e865-3b84-4750-9cba-646642ca0657 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:12.971085 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6188e865-3b84-4750-9cba-646642ca0657 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:12.993172 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-6188e865-3b84-4750-9cba-646642ca0657 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Getting quotas for project 63897275a7664529bc1d568ba2f36b15. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:33:12.999627 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-6188e865-3b84-4750-9cba-646642ca0657 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Getting quotas for user f1ef8bba622344a4bdb1b08532943f48 and project 63897275a7664529bc1d568ba2f36b15. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:33:13.069604 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6188e865-3b84-4750-9cba-646642ca0657 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Going to run 1 instances... {{(pid=116467) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:33:13.072826 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6188e865-3b84-4750-9cba-646642ca0657 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5fd815bf-781c-4d38-aacc-7ca5a444a6dc',volume_size=None,volume_type=None)] {{(pid=116467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:33:13.281966 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6188e865-3b84-4750-9cba-646642ca0657 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.250926 Jan 24 22:33:13.288555 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 426/834] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:33:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 24 22:33:13.373264 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-882ba6af-55e7-49b9-861c-b0e4076fec1d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:13.374651 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-882ba6af-55e7-49b9-861c-b0e4076fec1d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:13.383554 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-882ba6af-55e7-49b9-861c-b0e4076fec1d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:13.384543 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-882ba6af-55e7-49b9-861c-b0e4076fec1d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:13.385823 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-882ba6af-55e7-49b9-861c-b0e4076fec1d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:13.386594 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-882ba6af-55e7-49b9-861c-b0e4076fec1d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:13.482413 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-5e743731-0f06-4697-a9a9-82554ae23684 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:13.484043 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-5e743731-0f06-4697-a9a9-82554ae23684 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:13.491280 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5e743731-0f06-4697-a9a9-82554ae23684 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:13.492213 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5e743731-0f06-4697-a9a9-82554ae23684 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:13.493954 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5e743731-0f06-4697-a9a9-82554ae23684 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:13.494554 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5e743731-0f06-4697-a9a9-82554ae23684 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:13.510066 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-882ba6af-55e7-49b9-861c-b0e4076fec1d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 19342 microversion: 2.1 time: 0.472971 Jan 24 22:33:13.514595 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 409/835] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:13 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 19342 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:33:13.520035 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-363a848a-1cc0-4523-b561-cfdcc4974f3e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:13.520923 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-363a848a-1cc0-4523-b561-cfdcc4974f3e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:13.593183 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-363a848a-1cc0-4523-b561-cfdcc4974f3e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:13.606230 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-363a848a-1cc0-4523-b561-cfdcc4974f3e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1088 microversion: 2.1 time: 0.090137 Jan 24 22:33:13.619298 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 410/836] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:13 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1088 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:13.621298 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-5e743731-0f06-4697-a9a9-82554ae23684 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 25374 microversion: 2.20 time: 0.331131 Jan 24 22:33:13.622655 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 427/837] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:13 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 25374 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:13.641699 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-26e114bb-86fc-4173-b74d-f6244edbd2ba tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:13.642395 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-26e114bb-86fc-4173-b74d-f6244edbd2ba tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:13.650039 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-26e114bb-86fc-4173-b74d-f6244edbd2ba tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:13.650671 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-26e114bb-86fc-4173-b74d-f6244edbd2ba tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:13.651605 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-26e114bb-86fc-4173-b74d-f6244edbd2ba tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:13.652212 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-26e114bb-86fc-4173-b74d-f6244edbd2ba tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:13.688563 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-26e114bb-86fc-4173-b74d-f6244edbd2ba tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Going to try to terminate instance {{(pid=116466) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:33:13.815955 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-26e114bb-86fc-4173-b74d-f6244edbd2ba tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "DELETE /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce" status: 204 len: 0 microversion: 2.1 time: 0.177252 Jan 24 22:33:13.819922 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 411/838] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:33:13 2022] DELETE /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 24 22:33:13.826036 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-863ec744-ea1e-447a-91fd-401b19635768 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:13.827091 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-863ec744-ea1e-447a-91fd-401b19635768 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:13.838563 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-863ec744-ea1e-447a-91fd-401b19635768 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:13.839116 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-863ec744-ea1e-447a-91fd-401b19635768 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:13.840451 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-863ec744-ea1e-447a-91fd-401b19635768 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:13.840945 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-863ec744-ea1e-447a-91fd-401b19635768 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:14.474325 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-863ec744-ea1e-447a-91fd-401b19635768 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:14.483367 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-863ec744-ea1e-447a-91fd-401b19635768 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce" status: 200 len: 1513 microversion: 2.1 time: 0.661667 Jan 24 22:33:14.495440 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 428/839] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:13 2022] GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce => generated 1513 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:14.524959 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1bd3dec3-3ebb-4123-9bab-740a9cb68a57 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:14.527001 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-1bd3dec3-3ebb-4123-9bab-740a9cb68a57 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:14.534300 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1bd3dec3-3ebb-4123-9bab-740a9cb68a57 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:14.535186 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1bd3dec3-3ebb-4123-9bab-740a9cb68a57 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:14.535979 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1bd3dec3-3ebb-4123-9bab-740a9cb68a57 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:14.536404 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1bd3dec3-3ebb-4123-9bab-740a9cb68a57 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:14.623596 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-15d642a2-aef2-40f2-907d-6b40f56dcf5d tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:14.624199 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-15d642a2-aef2-40f2-907d-6b40f56dcf5d tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:14.631689 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-15d642a2-aef2-40f2-907d-6b40f56dcf5d tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:14.632714 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-15d642a2-aef2-40f2-907d-6b40f56dcf5d tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:14.633930 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-15d642a2-aef2-40f2-907d-6b40f56dcf5d tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:14.634363 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-15d642a2-aef2-40f2-907d-6b40f56dcf5d tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:14.654461 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-1bd3dec3-3ebb-4123-9bab-740a9cb68a57 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 21338 microversion: 2.1 time: 0.134618 Jan 24 22:33:14.655737 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 412/840] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:14 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 21338 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:14.661890 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-5d2555d8-eadf-4f2b-a9a1-53ca91e99431 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:14.663620 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-5d2555d8-eadf-4f2b-a9a1-53ca91e99431 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:14.671341 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5d2555d8-eadf-4f2b-a9a1-53ca91e99431 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:14.672045 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5d2555d8-eadf-4f2b-a9a1-53ca91e99431 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:14.672902 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5d2555d8-eadf-4f2b-a9a1-53ca91e99431 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:14.673451 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5d2555d8-eadf-4f2b-a9a1-53ca91e99431 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:14.702182 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-15d642a2-aef2-40f2-907d-6b40f56dcf5d tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:14.711349 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-15d642a2-aef2-40f2-907d-6b40f56dcf5d tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1186 microversion: 2.1 time: 0.091376 Jan 24 22:33:14.711932 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 429/841] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:14 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1186 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:33:14.792638 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-5d2555d8-eadf-4f2b-a9a1-53ca91e99431 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 26543 microversion: 2.20 time: 0.135185 Jan 24 22:33:14.794033 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 413/842] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:14 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 26543 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:15.502705 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b1f6d6e2-3683-4ba1-86fd-b69ab8ed835b tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:15.503352 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b1f6d6e2-3683-4ba1-86fd-b69ab8ed835b tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:15.512147 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b1f6d6e2-3683-4ba1-86fd-b69ab8ed835b tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:15.512597 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b1f6d6e2-3683-4ba1-86fd-b69ab8ed835b tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:15.513428 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b1f6d6e2-3683-4ba1-86fd-b69ab8ed835b tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:15.514049 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b1f6d6e2-3683-4ba1-86fd-b69ab8ed835b tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:15.667125 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-572ebcf6-cf74-4694-b3df-6c15236e4b59 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:15.668247 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-572ebcf6-cf74-4694-b3df-6c15236e4b59 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:15.678528 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-572ebcf6-cf74-4694-b3df-6c15236e4b59 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:15.679363 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-572ebcf6-cf74-4694-b3df-6c15236e4b59 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:15.681157 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-572ebcf6-cf74-4694-b3df-6c15236e4b59 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:15.690432 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-572ebcf6-cf74-4694-b3df-6c15236e4b59 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:15.822564 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-572ebcf6-cf74-4694-b3df-6c15236e4b59 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 22885 microversion: 2.1 time: 0.159299 Jan 24 22:33:15.823828 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 414/843] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:15 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 22885 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:33:15.831249 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-022284d5-50ab-42db-b550-89601ba13eba tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:15.835638 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-022284d5-50ab-42db-b550-89601ba13eba tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:15.849161 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-022284d5-50ab-42db-b550-89601ba13eba tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:15.853829 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-022284d5-50ab-42db-b550-89601ba13eba tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:15.854822 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-022284d5-50ab-42db-b550-89601ba13eba tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:15.855252 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-022284d5-50ab-42db-b550-89601ba13eba tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:15.867397 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b1f6d6e2-3683-4ba1-86fd-b69ab8ed835b tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:15.880180 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b1f6d6e2-3683-4ba1-86fd-b69ab8ed835b tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce" status: 200 len: 1513 microversion: 2.1 time: 0.379520 Jan 24 22:33:15.886718 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 430/844] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:15 2022] GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce => generated 1513 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:15.901213 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-beb6aad0-4f0a-4615-9f54-8ee42ca793db tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:15.902448 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-beb6aad0-4f0a-4615-9f54-8ee42ca793db tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:15.911520 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-beb6aad0-4f0a-4615-9f54-8ee42ca793db tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:15.917009 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-beb6aad0-4f0a-4615-9f54-8ee42ca793db tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:15.918243 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-beb6aad0-4f0a-4615-9f54-8ee42ca793db tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:15.918828 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-beb6aad0-4f0a-4615-9f54-8ee42ca793db tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:16.057980 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-beb6aad0-4f0a-4615-9f54-8ee42ca793db tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 27294 microversion: 2.20 time: 0.169754 Jan 24 22:33:16.059344 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 431/845] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:15 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 27294 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:16.174484 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-022284d5-50ab-42db-b550-89601ba13eba tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:16.184610 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-022284d5-50ab-42db-b550-89601ba13eba tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1272 microversion: 2.1 time: 0.359063 Jan 24 22:33:16.185211 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 415/846] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:15 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1272 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:16.834704 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0b30ae4e-685d-457b-930b-a26e1f3d3d98 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:16.835701 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0b30ae4e-685d-457b-930b-a26e1f3d3d98 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:16.854473 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0b30ae4e-685d-457b-930b-a26e1f3d3d98 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:16.854926 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0b30ae4e-685d-457b-930b-a26e1f3d3d98 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:16.855722 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0b30ae4e-685d-457b-930b-a26e1f3d3d98 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:16.856147 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0b30ae4e-685d-457b-930b-a26e1f3d3d98 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:16.904687 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-620b4e93-4f5a-411b-9b3a-5fdb51dd6be2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:16.905948 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-620b4e93-4f5a-411b-9b3a-5fdb51dd6be2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:16.912943 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-620b4e93-4f5a-411b-9b3a-5fdb51dd6be2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:16.913641 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-620b4e93-4f5a-411b-9b3a-5fdb51dd6be2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:16.914602 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-620b4e93-4f5a-411b-9b3a-5fdb51dd6be2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:16.915180 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-620b4e93-4f5a-411b-9b3a-5fdb51dd6be2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:16.982308 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0b30ae4e-685d-457b-930b-a26e1f3d3d98 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 24312 microversion: 2.1 time: 0.151760 Jan 24 22:33:16.983363 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 432/847] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:16 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 24312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:17.070589 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-8ebcb438-1ea1-4a52-bdc0-a4ddbf31b6e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:17.071834 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-8ebcb438-1ea1-4a52-bdc0-a4ddbf31b6e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:17.083522 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8ebcb438-1ea1-4a52-bdc0-a4ddbf31b6e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:17.083961 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8ebcb438-1ea1-4a52-bdc0-a4ddbf31b6e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:17.084750 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8ebcb438-1ea1-4a52-bdc0-a4ddbf31b6e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:17.085204 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8ebcb438-1ea1-4a52-bdc0-a4ddbf31b6e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:17.225776 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-8ebcb438-1ea1-4a52-bdc0-a4ddbf31b6e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 27817 microversion: 2.20 time: 0.158795 Jan 24 22:33:17.227024 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 433/848] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:17 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 27817 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:17.232499 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e263b29a-be98-457d-a206-209b10fcaa90 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:17.233441 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e263b29a-be98-457d-a206-209b10fcaa90 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:17.244122 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e263b29a-be98-457d-a206-209b10fcaa90 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:17.244576 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e263b29a-be98-457d-a206-209b10fcaa90 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:17.245409 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e263b29a-be98-457d-a206-209b10fcaa90 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:17.245829 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e263b29a-be98-457d-a206-209b10fcaa90 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:17.591196 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-620b4e93-4f5a-411b-9b3a-5fdb51dd6be2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:17.599371 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-620b4e93-4f5a-411b-9b3a-5fdb51dd6be2 tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce" status: 200 len: 1513 microversion: 2.1 time: 0.698577 Jan 24 22:33:17.605426 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 416/849] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:16 2022] GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce => generated 1513 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:17.621023 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-0965494d-62d1-4d40-982f-d18b1e4f83cc req-b29fe784-b45e-41fa-ba50-b08fe2554a95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1d2298-3059-437a-9f1a-6173d40e21ca", "tag": "4b3048ce-5caa-49ca-82eb-b694366739aa"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:17.622806 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:33:17.622806 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:33:17.643111 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-0965494d-62d1-4d40-982f-d18b1e4f83cc req-b29fe784-b45e-41fa-ba50-b08fe2554a95 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:17.644551 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-0965494d-62d1-4d40-982f-d18b1e4f83cc req-b29fe784-b45e-41fa-ba50-b08fe2554a95 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:17.694328 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-0965494d-62d1-4d40-982f-d18b1e4f83cc req-b29fe784-b45e-41fa-ba50-b08fe2554a95 service nova] Creating event network-changed:4b3048ce-5caa-49ca-82eb-b694366739aa for instance ab1d2298-3059-437a-9f1a-6173d40e21ca on hv-cinder-81322 Jan 24 22:33:17.708784 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-0965494d-62d1-4d40-982f-d18b1e4f83cc req-b29fe784-b45e-41fa-ba50-b08fe2554a95 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101722 Jan 24 22:33:17.709720 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 417/850] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:33:17.952339 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e263b29a-be98-457d-a206-209b10fcaa90 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:17.971940 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e263b29a-be98-457d-a206-209b10fcaa90 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1260 microversion: 2.1 time: 0.743539 Jan 24 22:33:17.978134 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 434/851] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:17 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1260 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:18.015248 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-43a7c17a-1578-4ec1-86ce-cfbdb014ccf5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:18.023571 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-43a7c17a-1578-4ec1-86ce-cfbdb014ccf5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:18.049299 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-43a7c17a-1578-4ec1-86ce-cfbdb014ccf5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:18.050349 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-43a7c17a-1578-4ec1-86ce-cfbdb014ccf5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:18.051367 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-43a7c17a-1578-4ec1-86ce-cfbdb014ccf5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:18.054174 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-43a7c17a-1578-4ec1-86ce-cfbdb014ccf5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:18.099837 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-e62803f0-34db-449a-ae9d-e95fe465c0ae req-b54a8e94-e55b-42af-86e0-cc27c72fbd56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce", "name": "network-vif-deleted", "tag": "f126ddae-4e06-40f8-ac9c-2e1f28a67f36"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:18.102811 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:33:18.102811 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:33:18.114284 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-e62803f0-34db-449a-ae9d-e95fe465c0ae req-b54a8e94-e55b-42af-86e0-cc27c72fbd56 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:18.115058 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-e62803f0-34db-449a-ae9d-e95fe465c0ae req-b54a8e94-e55b-42af-86e0-cc27c72fbd56 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:18.128467 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-e62803f0-34db-449a-ae9d-e95fe465c0ae req-b54a8e94-e55b-42af-86e0-cc27c72fbd56 service nova] Creating event network-vif-deleted:f126ddae-4e06-40f8-ac9c-2e1f28a67f36 for instance 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce on hv-cinder-81322 Jan 24 22:33:18.136566 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-e62803f0-34db-449a-ae9d-e95fe465c0ae req-b54a8e94-e55b-42af-86e0-cc27c72fbd56 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.336216 Jan 24 22:33:18.137717 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 418/852] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:33:18.217171 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-43a7c17a-1578-4ec1-86ce-cfbdb014ccf5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 25903 microversion: 2.1 time: 0.213554 Jan 24 22:33:18.218374 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 435/853] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:17 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 25903 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:18.240328 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-fb412f46-a12d-4909-a186-90a57e7b0f4a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:18.242177 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-fb412f46-a12d-4909-a186-90a57e7b0f4a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:18.251212 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fb412f46-a12d-4909-a186-90a57e7b0f4a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:18.252094 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fb412f46-a12d-4909-a186-90a57e7b0f4a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:18.253272 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fb412f46-a12d-4909-a186-90a57e7b0f4a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:18.253865 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fb412f46-a12d-4909-a186-90a57e7b0f4a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:18.374130 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-fb412f46-a12d-4909-a186-90a57e7b0f4a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 28187 microversion: 2.20 time: 0.139564 Jan 24 22:33:18.375209 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 419/854] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:18 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 28187 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:18.621435 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9d24d624-44ef-4dc7-a6cf-31cde4df823f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:18.622487 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9d24d624-44ef-4dc7-a6cf-31cde4df823f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:18.638166 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9d24d624-44ef-4dc7-a6cf-31cde4df823f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:18.640141 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9d24d624-44ef-4dc7-a6cf-31cde4df823f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:18.641184 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9d24d624-44ef-4dc7-a6cf-31cde4df823f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:18.643680 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9d24d624-44ef-4dc7-a6cf-31cde4df823f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:18.709851 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9d24d624-44ef-4dc7-a6cf-31cde4df823f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:18.710297 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9d24d624-44ef-4dc7-a6cf-31cde4df823f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:18.710758 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-9d24d624-44ef-4dc7-a6cf-31cde4df823f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lazy-loading 'fault' on Instance uuid 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:33:18.995403 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-4e43b727-9a01-49d2-8610-6ba95a7d9935 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:18.996109 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-4e43b727-9a01-49d2-8610-6ba95a7d9935 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:18.996446 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-9d24d624-44ef-4dc7-a6cf-31cde4df823f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4ada062ed8433da1795195691f241c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc5a655a0b0f4f0482453bde6f196195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:19.007715 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4e43b727-9a01-49d2-8610-6ba95a7d9935 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:19.008153 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4e43b727-9a01-49d2-8610-6ba95a7d9935 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:19.009140 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9d24d624-44ef-4dc7-a6cf-31cde4df823f tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce" status: 200 len: 1309 microversion: 2.1 time: 0.394245 Jan 24 22:33:19.013318 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4e43b727-9a01-49d2-8610-6ba95a7d9935 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:19.013761 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4e43b727-9a01-49d2-8610-6ba95a7d9935 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:19.014498 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 436/855] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:18 2022] GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce => generated 1309 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:19.234931 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-169f24af-10bb-45a4-ae37-80efb5767132 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:19.236297 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-169f24af-10bb-45a4-ae37-80efb5767132 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:19.255338 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-169f24af-10bb-45a4-ae37-80efb5767132 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:19.256038 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-169f24af-10bb-45a4-ae37-80efb5767132 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:19.258933 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-169f24af-10bb-45a4-ae37-80efb5767132 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:19.260252 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-169f24af-10bb-45a4-ae37-80efb5767132 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:19.263208 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-4e43b727-9a01-49d2-8610-6ba95a7d9935 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:19.300631 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-4e43b727-9a01-49d2-8610-6ba95a7d9935 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1260 microversion: 2.1 time: 0.308939 Jan 24 22:33:19.302271 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 420/856] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:18 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1260 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:33:19.387967 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-bcde51ea-6cbf-446b-9134-783e3044644f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:19.389083 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-bcde51ea-6cbf-446b-9134-783e3044644f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:19.400270 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bcde51ea-6cbf-446b-9134-783e3044644f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:19.412226 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bcde51ea-6cbf-446b-9134-783e3044644f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:19.413665 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bcde51ea-6cbf-446b-9134-783e3044644f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:19.414228 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bcde51ea-6cbf-446b-9134-783e3044644f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:19.429886 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-169f24af-10bb-45a4-ae37-80efb5767132 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 27013 microversion: 2.1 time: 0.203007 Jan 24 22:33:19.434186 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 437/857] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:19 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 27013 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:19.555447 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-bcde51ea-6cbf-446b-9134-783e3044644f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 28187 microversion: 2.20 time: 0.169761 Jan 24 22:33:19.558704 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 421/858] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:19 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 28187 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:20.038199 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3fb5f7cc-fc55-4a50-a950-69c52e14574a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:20.039742 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-3fb5f7cc-fc55-4a50-a950-69c52e14574a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] [instance: 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:20.047143 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3fb5f7cc-fc55-4a50-a950-69c52e14574a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:20.047657 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3fb5f7cc-fc55-4a50-a950-69c52e14574a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:20.049123 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3fb5f7cc-fc55-4a50-a950-69c52e14574a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:20.049693 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3fb5f7cc-fc55-4a50-a950-69c52e14574a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:20.066418 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-3fb5f7cc-fc55-4a50-a950-69c52e14574a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] HTTP exception thrown: Instance 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce could not be found. Jan 24 22:33:20.067027 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3fb5f7cc-fc55-4a50-a950-69c52e14574a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] Returning 404 to user: Instance 6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:33:20.067865 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-3fb5f7cc-fc55-4a50-a950-69c52e14574a tempest-VolumesSnapshotTestJSON-1589658802 tempest-VolumesSnapshotTestJSON-1589658802-project] 10.222.0.84 "GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce" status: 404 len: 111 microversion: 2.1 time: 0.036401 Jan 24 22:33:20.068415 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 438/859] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:20 2022] GET /compute/v2.1/servers/6bfbdbee-56d5-4eee-9a2a-d3f14fbfbcce => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:33:20.319462 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-4cb3af46-051c-4f51-bfc0-46d5617a4e7a tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:20.320288 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-4cb3af46-051c-4f51-bfc0-46d5617a4e7a tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:20.350244 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4cb3af46-051c-4f51-bfc0-46d5617a4e7a tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:20.350910 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4cb3af46-051c-4f51-bfc0-46d5617a4e7a tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:20.351913 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4cb3af46-051c-4f51-bfc0-46d5617a4e7a tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:20.359020 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4cb3af46-051c-4f51-bfc0-46d5617a4e7a tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:20.442236 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a30fffa8-936b-45c8-9b8f-07d58bdfaad5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:20.443395 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a30fffa8-936b-45c8-9b8f-07d58bdfaad5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:20.454196 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a30fffa8-936b-45c8-9b8f-07d58bdfaad5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:20.461259 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a30fffa8-936b-45c8-9b8f-07d58bdfaad5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:20.462261 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a30fffa8-936b-45c8-9b8f-07d58bdfaad5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:20.462972 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a30fffa8-936b-45c8-9b8f-07d58bdfaad5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:20.558903 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-4cb3af46-051c-4f51-bfc0-46d5617a4e7a tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:20.567121 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-4cb3af46-051c-4f51-bfc0-46d5617a4e7a tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1260 microversion: 2.1 time: 0.251573 Jan 24 22:33:20.568610 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 422/860] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:20 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:20.576076 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e7e4ba8e-7826-470c-961f-303f676ff3fa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:20.577752 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e7e4ba8e-7826-470c-961f-303f676ff3fa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:20.581957 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a30fffa8-936b-45c8-9b8f-07d58bdfaad5 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 27638 microversion: 2.1 time: 0.143782 Jan 24 22:33:20.582824 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 439/861] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:20 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 27638 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:20.589684 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e7e4ba8e-7826-470c-961f-303f676ff3fa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:20.590371 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e7e4ba8e-7826-470c-961f-303f676ff3fa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:20.591228 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e7e4ba8e-7826-470c-961f-303f676ff3fa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:20.591757 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e7e4ba8e-7826-470c-961f-303f676ff3fa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:20.710058 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e7e4ba8e-7826-470c-961f-303f676ff3fa tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 28478 microversion: 2.20 time: 0.139976 Jan 24 22:33:20.714210 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 423/862] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:20 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 28478 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:21.588391 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e70f8805-f526-4f37-9e76-8ffe3e22698b tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:21.589765 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e70f8805-f526-4f37-9e76-8ffe3e22698b tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:21.595602 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2d9c1685-a416-4463-817b-b9287de9e7e7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:21.597481 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2d9c1685-a416-4463-817b-b9287de9e7e7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:21.599683 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e70f8805-f526-4f37-9e76-8ffe3e22698b tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:21.600125 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e70f8805-f526-4f37-9e76-8ffe3e22698b tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:21.600942 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e70f8805-f526-4f37-9e76-8ffe3e22698b tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:21.601776 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e70f8805-f526-4f37-9e76-8ffe3e22698b tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:21.608071 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2d9c1685-a416-4463-817b-b9287de9e7e7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:21.608850 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2d9c1685-a416-4463-817b-b9287de9e7e7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:21.611414 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2d9c1685-a416-4463-817b-b9287de9e7e7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:21.612108 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2d9c1685-a416-4463-817b-b9287de9e7e7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:21.732627 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2d9c1685-a416-4463-817b-b9287de9e7e7 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 28056 microversion: 2.1 time: 0.141909 Jan 24 22:33:21.733353 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 424/863] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:21 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 28056 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:33:21.740249 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-acad49d2-06ad-4392-9105-dc7fdcc51ae0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:21.744175 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-acad49d2-06ad-4392-9105-dc7fdcc51ae0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:21.751375 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-acad49d2-06ad-4392-9105-dc7fdcc51ae0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:21.752037 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-acad49d2-06ad-4392-9105-dc7fdcc51ae0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:21.752961 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-acad49d2-06ad-4392-9105-dc7fdcc51ae0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:21.753790 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-acad49d2-06ad-4392-9105-dc7fdcc51ae0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:21.816812 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e70f8805-f526-4f37-9e76-8ffe3e22698b tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:21.826249 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e70f8805-f526-4f37-9e76-8ffe3e22698b tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1260 microversion: 2.1 time: 0.245976 Jan 24 22:33:21.827097 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 440/864] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:21 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:21.860660 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-acad49d2-06ad-4392-9105-dc7fdcc51ae0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 28646 microversion: 2.20 time: 0.125579 Jan 24 22:33:21.861484 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 425/865] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:21 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 28646 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:22.744828 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-07ca9a5b-a137-4019-b553-80b53d30ee22 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:22.746155 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-07ca9a5b-a137-4019-b553-80b53d30ee22 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:22.759647 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-07ca9a5b-a137-4019-b553-80b53d30ee22 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:22.760371 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-07ca9a5b-a137-4019-b553-80b53d30ee22 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:22.762451 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-07ca9a5b-a137-4019-b553-80b53d30ee22 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:22.763965 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-07ca9a5b-a137-4019-b553-80b53d30ee22 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:22.844463 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e555bdaa-bc94-4c1d-bb53-03b5273baa08 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:22.849628 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e555bdaa-bc94-4c1d-bb53-03b5273baa08 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:22.860370 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e555bdaa-bc94-4c1d-bb53-03b5273baa08 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:22.861664 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e555bdaa-bc94-4c1d-bb53-03b5273baa08 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:22.862749 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e555bdaa-bc94-4c1d-bb53-03b5273baa08 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:22.863553 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e555bdaa-bc94-4c1d-bb53-03b5273baa08 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:23.026257 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e555bdaa-bc94-4c1d-bb53-03b5273baa08 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:23.034699 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e555bdaa-bc94-4c1d-bb53-03b5273baa08 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1260 microversion: 2.1 time: 0.194865 Jan 24 22:33:23.035280 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 426/866] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:22 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:33:23.043226 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a102e294-f4d7-4987-91a3-98984f9ef643 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:23.044563 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a102e294-f4d7-4987-91a3-98984f9ef643 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:23.051078 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a102e294-f4d7-4987-91a3-98984f9ef643 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:23.051682 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a102e294-f4d7-4987-91a3-98984f9ef643 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:23.052646 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a102e294-f4d7-4987-91a3-98984f9ef643 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:23.053126 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a102e294-f4d7-4987-91a3-98984f9ef643 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:24.635647 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-07ca9a5b-a137-4019-b553-80b53d30ee22 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 28183 microversion: 2.1 time: 1.894243 Jan 24 22:33:24.640837 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 441/867] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:22 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 28183 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:24.646213 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a223561a-c485-4496-a0bf-8caf4e0c1243 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:24.647187 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a223561a-c485-4496-a0bf-8caf4e0c1243 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:24.654988 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a223561a-c485-4496-a0bf-8caf4e0c1243 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:24.655710 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a223561a-c485-4496-a0bf-8caf4e0c1243 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:24.656683 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a223561a-c485-4496-a0bf-8caf4e0c1243 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:24.657339 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a223561a-c485-4496-a0bf-8caf4e0c1243 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:24.662390 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a102e294-f4d7-4987-91a3-98984f9ef643 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 28646 microversion: 2.20 time: 1.625703 Jan 24 22:33:24.663047 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 427/868] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:23 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 28646 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:24.808774 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a223561a-c485-4496-a0bf-8caf4e0c1243 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:24.820208 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a223561a-c485-4496-a0bf-8caf4e0c1243 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1260 microversion: 2.1 time: 0.177908 Jan 24 22:33:24.820805 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 442/869] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:24 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:25.648551 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7fa26cfe-20a5-4481-b98e-a83ae0e91780 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:25.649582 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7fa26cfe-20a5-4481-b98e-a83ae0e91780 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:25.656760 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7fa26cfe-20a5-4481-b98e-a83ae0e91780 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:25.657498 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7fa26cfe-20a5-4481-b98e-a83ae0e91780 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:25.659216 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7fa26cfe-20a5-4481-b98e-a83ae0e91780 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:25.659862 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7fa26cfe-20a5-4481-b98e-a83ae0e91780 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:25.678476 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-efc249a8-5f27-4ed0-a711-15327eb84d9e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:25.679575 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-efc249a8-5f27-4ed0-a711-15327eb84d9e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:25.689078 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-efc249a8-5f27-4ed0-a711-15327eb84d9e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:25.689941 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-efc249a8-5f27-4ed0-a711-15327eb84d9e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:25.690947 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-efc249a8-5f27-4ed0-a711-15327eb84d9e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:25.691585 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-efc249a8-5f27-4ed0-a711-15327eb84d9e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:25.774926 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7fa26cfe-20a5-4481-b98e-a83ae0e91780 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 28183 microversion: 2.1 time: 0.130236 Jan 24 22:33:25.778767 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 428/870] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:25 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 28183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:25.800840 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-efc249a8-5f27-4ed0-a711-15327eb84d9e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 28646 microversion: 2.20 time: 0.128175 Jan 24 22:33:25.805536 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 443/871] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:25 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 28646 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:25.844272 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-d97c79e4-a135-4432-82bf-aa58e8e60e76 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:25.844946 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d97c79e4-a135-4432-82bf-aa58e8e60e76 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:25.856161 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d97c79e4-a135-4432-82bf-aa58e8e60e76 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:25.856812 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d97c79e4-a135-4432-82bf-aa58e8e60e76 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:25.857462 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d97c79e4-a135-4432-82bf-aa58e8e60e76 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:25.857910 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d97c79e4-a135-4432-82bf-aa58e8e60e76 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:26.010812 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d97c79e4-a135-4432-82bf-aa58e8e60e76 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:26.019267 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-d97c79e4-a135-4432-82bf-aa58e8e60e76 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1260 microversion: 2.1 time: 0.180195 Jan 24 22:33:26.029410 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 429/872] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:25 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:26.787610 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b779e7b4-c0d8-4660-af39-592e7cf3814a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:26.790061 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b779e7b4-c0d8-4660-af39-592e7cf3814a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:26.814048 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1bcc2761-b98d-4c2f-b158-8ee026af92c8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:26.816008 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-1bcc2761-b98d-4c2f-b158-8ee026af92c8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:26.820022 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b779e7b4-c0d8-4660-af39-592e7cf3814a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:26.823037 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b779e7b4-c0d8-4660-af39-592e7cf3814a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:26.824085 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b779e7b4-c0d8-4660-af39-592e7cf3814a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:26.826210 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b779e7b4-c0d8-4660-af39-592e7cf3814a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:26.834415 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1bcc2761-b98d-4c2f-b158-8ee026af92c8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:26.834864 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1bcc2761-b98d-4c2f-b158-8ee026af92c8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:26.835670 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1bcc2761-b98d-4c2f-b158-8ee026af92c8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:26.846614 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1bcc2761-b98d-4c2f-b158-8ee026af92c8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:26.989120 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b779e7b4-c0d8-4660-af39-592e7cf3814a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 28474 microversion: 2.1 time: 0.206136 Jan 24 22:33:26.993863 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 444/873] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:26 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 28474 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:27.016508 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-1bcc2761-b98d-4c2f-b158-8ee026af92c8 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 28646 microversion: 2.20 time: 0.206880 Jan 24 22:33:27.017724 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 430/874] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:26 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 28646 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:27.039887 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-adb6d4f9-e898-4128-a2ac-92b6b2ee585f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:27.041387 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-adb6d4f9-e898-4128-a2ac-92b6b2ee585f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:27.057709 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-adb6d4f9-e898-4128-a2ac-92b6b2ee585f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:27.058597 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-adb6d4f9-e898-4128-a2ac-92b6b2ee585f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:27.060047 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-adb6d4f9-e898-4128-a2ac-92b6b2ee585f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:27.062438 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-adb6d4f9-e898-4128-a2ac-92b6b2ee585f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:27.278257 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-adb6d4f9-e898-4128-a2ac-92b6b2ee585f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:27.288558 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-adb6d4f9-e898-4128-a2ac-92b6b2ee585f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1260 microversion: 2.1 time: 0.255803 Jan 24 22:33:27.289083 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 445/875] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:27 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1260 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:28.008333 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c35d59d9-ec51-4087-90e4-81010f68d417 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:28.010116 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c35d59d9-ec51-4087-90e4-81010f68d417 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:28.029617 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-001d2ce8-cb56-40c6-bbcf-4d41a80ecfd5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:28.031260 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-001d2ce8-cb56-40c6-bbcf-4d41a80ecfd5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:28.043220 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c35d59d9-ec51-4087-90e4-81010f68d417 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:28.045225 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c35d59d9-ec51-4087-90e4-81010f68d417 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:28.046087 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-001d2ce8-cb56-40c6-bbcf-4d41a80ecfd5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:28.047221 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c35d59d9-ec51-4087-90e4-81010f68d417 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:28.047850 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-001d2ce8-cb56-40c6-bbcf-4d41a80ecfd5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:28.048855 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-001d2ce8-cb56-40c6-bbcf-4d41a80ecfd5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:28.049691 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c35d59d9-ec51-4087-90e4-81010f68d417 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:28.051038 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-001d2ce8-cb56-40c6-bbcf-4d41a80ecfd5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:28.179142 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-001d2ce8-cb56-40c6-bbcf-4d41a80ecfd5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 28646 microversion: 2.20 time: 0.153934 Jan 24 22:33:28.184823 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 446/876] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:28 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 28646 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:28.218460 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c35d59d9-ec51-4087-90e4-81010f68d417 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 28642 microversion: 2.1 time: 0.219553 Jan 24 22:33:28.225390 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 431/877] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:27 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 28642 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:28.306432 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2624cb81-b72c-4a35-9fe5-ba854e90b44c tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:28.307280 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2624cb81-b72c-4a35-9fe5-ba854e90b44c tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:28.315223 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2624cb81-b72c-4a35-9fe5-ba854e90b44c tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:28.315827 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2624cb81-b72c-4a35-9fe5-ba854e90b44c tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:28.316734 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2624cb81-b72c-4a35-9fe5-ba854e90b44c tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:28.317263 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2624cb81-b72c-4a35-9fe5-ba854e90b44c tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:28.472774 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2624cb81-b72c-4a35-9fe5-ba854e90b44c tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:28.480487 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2624cb81-b72c-4a35-9fe5-ba854e90b44c tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1260 microversion: 2.1 time: 0.178622 Jan 24 22:33:28.481045 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 447/878] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:28 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:29.193542 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-50f173a8-bc38-4a7b-893c-736bab4472e2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:29.196623 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-50f173a8-bc38-4a7b-893c-736bab4472e2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:29.215196 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-50f173a8-bc38-4a7b-893c-736bab4472e2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:29.215950 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-50f173a8-bc38-4a7b-893c-736bab4472e2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:29.217417 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-50f173a8-bc38-4a7b-893c-736bab4472e2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:29.218007 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-50f173a8-bc38-4a7b-893c-736bab4472e2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:29.235862 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-56052715-7a7a-4234-bf94-20ccd7de311e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:29.238951 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-56052715-7a7a-4234-bf94-20ccd7de311e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:29.252725 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-56052715-7a7a-4234-bf94-20ccd7de311e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:29.257449 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-56052715-7a7a-4234-bf94-20ccd7de311e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:29.260316 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-56052715-7a7a-4234-bf94-20ccd7de311e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:29.265786 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-56052715-7a7a-4234-bf94-20ccd7de311e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:29.402393 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-50f173a8-bc38-4a7b-893c-736bab4472e2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 29424 microversion: 2.20 time: 0.214975 Jan 24 22:33:29.403207 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 432/879] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:29 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 29424 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:29.437798 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-56052715-7a7a-4234-bf94-20ccd7de311e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 28642 microversion: 2.1 time: 0.209389 Jan 24 22:33:29.438471 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 448/880] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:29 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 28642 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:33:29.500075 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2c4f9436-94ad-4a68-bff9-291a51af9e7c tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:29.500874 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2c4f9436-94ad-4a68-bff9-291a51af9e7c tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:29.518300 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2c4f9436-94ad-4a68-bff9-291a51af9e7c tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:29.519089 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-4e83f57e-1e1c-4272-a5ba-be9f85638038 req-08d82ae7-e7ec-4ddc-8e49-55d79c3fda91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1d2298-3059-437a-9f1a-6173d40e21ca", "name": "network-vif-plugged", "status": "completed", "tag": "4b3048ce-5caa-49ca-82eb-b694366739aa"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:29.519257 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2c4f9436-94ad-4a68-bff9-291a51af9e7c tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:29.519927 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2c4f9436-94ad-4a68-bff9-291a51af9e7c tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:29.520364 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2c4f9436-94ad-4a68-bff9-291a51af9e7c tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:29.521756 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:33:29.521756 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:33:29.529276 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-4e83f57e-1e1c-4272-a5ba-be9f85638038 req-08d82ae7-e7ec-4ddc-8e49-55d79c3fda91 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:29.530073 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-4e83f57e-1e1c-4272-a5ba-be9f85638038 req-08d82ae7-e7ec-4ddc-8e49-55d79c3fda91 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:29.541711 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-4e83f57e-1e1c-4272-a5ba-be9f85638038 req-08d82ae7-e7ec-4ddc-8e49-55d79c3fda91 service nova] Creating event network-vif-plugged:4b3048ce-5caa-49ca-82eb-b694366739aa for instance ab1d2298-3059-437a-9f1a-6173d40e21ca on hv-cinder-81322 Jan 24 22:33:29.548206 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-4e83f57e-1e1c-4272-a5ba-be9f85638038 req-08d82ae7-e7ec-4ddc-8e49-55d79c3fda91 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143371 Jan 24 22:33:29.549589 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 433/881] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:33:29.684586 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2c4f9436-94ad-4a68-bff9-291a51af9e7c tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:29.693517 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2c4f9436-94ad-4a68-bff9-291a51af9e7c tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1260 microversion: 2.1 time: 0.199072 Jan 24 22:33:29.694625 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 449/882] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:29 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:33:30.415640 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8bcc5d5b-b2bd-48e7-9314-c440f537c503 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:30.417406 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8bcc5d5b-b2bd-48e7-9314-c440f537c503 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:30.423948 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8bcc5d5b-b2bd-48e7-9314-c440f537c503 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:30.424786 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8bcc5d5b-b2bd-48e7-9314-c440f537c503 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:30.425619 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8bcc5d5b-b2bd-48e7-9314-c440f537c503 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:30.426206 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8bcc5d5b-b2bd-48e7-9314-c440f537c503 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:30.450508 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ef50d51f-730c-40dd-a4d3-05752bfc425c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:30.454119 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ef50d51f-730c-40dd-a4d3-05752bfc425c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:30.461533 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ef50d51f-730c-40dd-a4d3-05752bfc425c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:30.462314 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ef50d51f-730c-40dd-a4d3-05752bfc425c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:30.463309 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ef50d51f-730c-40dd-a4d3-05752bfc425c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:30.464186 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ef50d51f-730c-40dd-a4d3-05752bfc425c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:32.185251 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ef50d51f-730c-40dd-a4d3-05752bfc425c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 28642 microversion: 2.1 time: 1.738777 Jan 24 22:33:32.185983 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 450/883] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:30 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 28642 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 22:33:32.190635 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b492f524-5c5b-4c0a-aad6-dfa6cf16f113 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:32.191335 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b492f524-5c5b-4c0a-aad6-dfa6cf16f113 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:32.198447 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b492f524-5c5b-4c0a-aad6-dfa6cf16f113 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:32.198884 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b492f524-5c5b-4c0a-aad6-dfa6cf16f113 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:32.199649 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b492f524-5c5b-4c0a-aad6-dfa6cf16f113 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:32.200068 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b492f524-5c5b-4c0a-aad6-dfa6cf16f113 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:32.234116 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8bcc5d5b-b2bd-48e7-9314-c440f537c503 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 33430 microversion: 2.20 time: 1.823046 Jan 24 22:33:32.238304 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 434/884] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:30 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 33430 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:32.241339 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-676ea4ad-0d59-4787-9256-de3198bdc9f1 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Action: 'create', calling method: .version_select at 0x7f7e5d149820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1311276800"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:32.258075 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-676ea4ad-0d59-4787-9256-de3198bdc9f1 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Getting quotas for project 87f09686992a4d389c166bb0f9704e4c. Resources: {'key_pairs'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:33:32.265507 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-676ea4ad-0d59-4787-9256-de3198bdc9f1 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Getting quotas for user bf2638a34c8b4cb0bc4149d4c061835d and project 87f09686992a4d389c166bb0f9704e4c. Resources: {'key_pairs'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:33:32.350222 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b492f524-5c5b-4c0a-aad6-dfa6cf16f113 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:32.362879 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b492f524-5c5b-4c0a-aad6-dfa6cf16f113 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1260 microversion: 2.1 time: 0.175484 Jan 24 22:33:32.363684 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 451/885] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:32 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:32.384472 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-676ea4ad-0d59-4787-9256-de3198bdc9f1 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Getting quotas for project 87f09686992a4d389c166bb0f9704e4c. Resources: {'key_pairs'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:33:32.388230 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-676ea4ad-0d59-4787-9256-de3198bdc9f1 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Getting quotas for user bf2638a34c8b4cb0bc4149d4c061835d and project 87f09686992a4d389c166bb0f9704e4c. Resources: {'key_pairs'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:33:32.409832 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-676ea4ad-0d59-4787-9256-de3198bdc9f1 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.172610 Jan 24 22:33:32.410620 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 435/886] 10.222.0.84 () {60 vars in 1157 bytes} [Mon Jan 24 22:33:32 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:32.466698 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-67218c4c-d0ec-49b9-a662-ac1d1fd57a1b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1109643657", "imageRef": "c9e21377-0612-49b7-99ba-a3801f58aa91", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1311276800", "networks": [{"uuid": "cecdc8eb-11b7-4424-8f69-878cca15f5a9"}]}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:32.525464 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.network.neutron [None req-67218c4c-d0ec-49b9-a662-ac1d1fd57a1b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] validate_networks() for [('cecdc8eb-11b7-4424-8f69-878cca15f5a9', None, None, None, None, None)] {{(pid=116467) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:33:32.905124 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-67218c4c-d0ec-49b9-a662-ac1d1fd57a1b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Flavor limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:33:32.905700 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-67218c4c-d0ec-49b9-a662-ac1d1fd57a1b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Image limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:33:32.906367 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-67218c4c-d0ec-49b9-a662-ac1d1fd57a1b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Flavor pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:33:32.906959 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-67218c4c-d0ec-49b9-a662-ac1d1fd57a1b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Image pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:33:32.907811 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-67218c4c-d0ec-49b9-a662-ac1d1fd57a1b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:33:32.921542 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-67218c4c-d0ec-49b9-a662-ac1d1fd57a1b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:32.922171 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-67218c4c-d0ec-49b9-a662-ac1d1fd57a1b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:32.923473 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-67218c4c-d0ec-49b9-a662-ac1d1fd57a1b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:32.924089 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-67218c4c-d0ec-49b9-a662-ac1d1fd57a1b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:32.942815 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-67218c4c-d0ec-49b9-a662-ac1d1fd57a1b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Getting quotas for project 87f09686992a4d389c166bb0f9704e4c. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:33:32.948902 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-67218c4c-d0ec-49b9-a662-ac1d1fd57a1b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Getting quotas for user bf2638a34c8b4cb0bc4149d4c061835d and project 87f09686992a4d389c166bb0f9704e4c. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:33:32.962301 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-67218c4c-d0ec-49b9-a662-ac1d1fd57a1b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Going to run 1 instances... {{(pid=116467) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:33:32.964507 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-67218c4c-d0ec-49b9-a662-ac1d1fd57a1b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9e21377-0612-49b7-99ba-a3801f58aa91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:33:33.013660 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-67218c4c-d0ec-49b9-a662-ac1d1fd57a1b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555247 Jan 24 22:33:33.014438 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 452/887] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:33:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 24 22:33:33.025230 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-4253f5ba-66e7-4289-b277-af35ab1852f1 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:33.025985 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-4253f5ba-66e7-4289-b277-af35ab1852f1 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:33.082490 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-4253f5ba-66e7-4289-b277-af35ab1852f1 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:33.090412 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-4253f5ba-66e7-4289-b277-af35ab1852f1 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1259 microversion: 2.1 time: 0.069560 Jan 24 22:33:33.091009 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 436/888] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:33 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:33.200014 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-07dc2359-931c-4921-ac05-c8b828dd8e2b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:33.201088 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-07dc2359-931c-4921-ac05-c8b828dd8e2b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:33.209145 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-07dc2359-931c-4921-ac05-c8b828dd8e2b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:33.209576 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-07dc2359-931c-4921-ac05-c8b828dd8e2b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:33.210415 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-07dc2359-931c-4921-ac05-c8b828dd8e2b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:33.210934 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-07dc2359-931c-4921-ac05-c8b828dd8e2b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:33.245940 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-9851184f-0d60-46d3-93cc-3aeb03dee432 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:33.247110 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-9851184f-0d60-46d3-93cc-3aeb03dee432 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:33.255465 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9851184f-0d60-46d3-93cc-3aeb03dee432 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:33.255918 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9851184f-0d60-46d3-93cc-3aeb03dee432 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:33.257078 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9851184f-0d60-46d3-93cc-3aeb03dee432 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:33.257518 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9851184f-0d60-46d3-93cc-3aeb03dee432 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:33.359764 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-07dc2359-931c-4921-ac05-c8b828dd8e2b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 28642 microversion: 2.1 time: 0.164453 Jan 24 22:33:33.361764 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 453/889] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:33 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 28642 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:33.381383 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-219d5194-7fd7-42b4-9ccb-b35d288d190a tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:33.382439 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-219d5194-7fd7-42b4-9ccb-b35d288d190a tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:33.389779 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-219d5194-7fd7-42b4-9ccb-b35d288d190a tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:33.390214 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-219d5194-7fd7-42b4-9ccb-b35d288d190a tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:33.390994 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-219d5194-7fd7-42b4-9ccb-b35d288d190a tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:33.391421 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-219d5194-7fd7-42b4-9ccb-b35d288d190a tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:33.407706 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-9851184f-0d60-46d3-93cc-3aeb03dee432 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 34318 microversion: 2.20 time: 0.165132 Jan 24 22:33:33.409444 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 437/890] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:33 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 34318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:33.542983 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-219d5194-7fd7-42b4-9ccb-b35d288d190a tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:33.551759 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-219d5194-7fd7-42b4-9ccb-b35d288d190a tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1260 microversion: 2.1 time: 0.174192 Jan 24 22:33:33.554745 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 454/891] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:33 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:33:34.108036 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-300cb0c2-b2ba-4e0e-9e95-370f301fa78f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:34.108738 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-300cb0c2-b2ba-4e0e-9e95-370f301fa78f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:34.116160 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-300cb0c2-b2ba-4e0e-9e95-370f301fa78f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:34.116584 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-300cb0c2-b2ba-4e0e-9e95-370f301fa78f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:34.117438 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-300cb0c2-b2ba-4e0e-9e95-370f301fa78f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:34.117868 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-300cb0c2-b2ba-4e0e-9e95-370f301fa78f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:34.179872 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-300cb0c2-b2ba-4e0e-9e95-370f301fa78f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:34.187547 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-300cb0c2-b2ba-4e0e-9e95-370f301fa78f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1311 microversion: 2.1 time: 0.083608 Jan 24 22:33:34.188348 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 438/892] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:34 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1311 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:34.372909 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3dc27df0-bbf0-4db0-b495-509f4ffe726c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:34.374570 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-3dc27df0-bbf0-4db0-b495-509f4ffe726c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:34.380952 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3dc27df0-bbf0-4db0-b495-509f4ffe726c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:34.382159 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3dc27df0-bbf0-4db0-b495-509f4ffe726c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:34.383067 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3dc27df0-bbf0-4db0-b495-509f4ffe726c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:34.383500 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3dc27df0-bbf0-4db0-b495-509f4ffe726c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:34.419959 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6b52bd4b-3f7d-40cd-a195-7c68c0d28504 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:34.420943 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6b52bd4b-3f7d-40cd-a195-7c68c0d28504 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:34.429391 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6b52bd4b-3f7d-40cd-a195-7c68c0d28504 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:34.429869 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6b52bd4b-3f7d-40cd-a195-7c68c0d28504 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:34.430659 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6b52bd4b-3f7d-40cd-a195-7c68c0d28504 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:34.431091 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6b52bd4b-3f7d-40cd-a195-7c68c0d28504 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:34.511671 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-3dc27df0-bbf0-4db0-b495-509f4ffe726c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 28642 microversion: 2.1 time: 0.142670 Jan 24 22:33:34.515808 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 455/893] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:34 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 28642 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:34.570762 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-48e217ca-45f3-40ec-9a7e-af68d6c85455 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:34.571636 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-48e217ca-45f3-40ec-9a7e-af68d6c85455 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:34.579398 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-48e217ca-45f3-40ec-9a7e-af68d6c85455 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:34.579901 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-48e217ca-45f3-40ec-9a7e-af68d6c85455 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:34.580897 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-48e217ca-45f3-40ec-9a7e-af68d6c85455 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:34.581357 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-48e217ca-45f3-40ec-9a7e-af68d6c85455 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:34.605895 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6b52bd4b-3f7d-40cd-a195-7c68c0d28504 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 35365 microversion: 2.20 time: 0.189785 Jan 24 22:33:34.612413 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 439/894] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:34 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 35365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:33:34.764952 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-48e217ca-45f3-40ec-9a7e-af68d6c85455 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:34.773358 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-48e217ca-45f3-40ec-9a7e-af68d6c85455 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1444 microversion: 2.1 time: 0.206751 Jan 24 22:33:34.773939 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 456/895] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:34 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1444 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:33:34.792109 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-faf63ef9-b8d8-4c37-9954-2f7123cc0e67 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:34.792794 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-faf63ef9-b8d8-4c37-9954-2f7123cc0e67 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:34.800370 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-faf63ef9-b8d8-4c37-9954-2f7123cc0e67 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:34.800827 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-faf63ef9-b8d8-4c37-9954-2f7123cc0e67 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:34.801648 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-faf63ef9-b8d8-4c37-9954-2f7123cc0e67 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:34.802261 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-faf63ef9-b8d8-4c37-9954-2f7123cc0e67 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:35.000325 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-faf63ef9-b8d8-4c37-9954-2f7123cc0e67 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:35.009577 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-faf63ef9-b8d8-4c37-9954-2f7123cc0e67 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1444 microversion: 2.1 time: 0.221475 Jan 24 22:33:35.021140 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 440/896] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:34 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1444 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:35.204290 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-50b0a414-db32-4367-97b4-c2f1542a53de tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:35.205123 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-50b0a414-db32-4367-97b4-c2f1542a53de tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:35.213239 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-50b0a414-db32-4367-97b4-c2f1542a53de tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:35.213679 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-50b0a414-db32-4367-97b4-c2f1542a53de tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:35.214389 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-50b0a414-db32-4367-97b4-c2f1542a53de tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:35.214831 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-50b0a414-db32-4367-97b4-c2f1542a53de tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:35.479600 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-50b0a414-db32-4367-97b4-c2f1542a53de tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:35.491464 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-50b0a414-db32-4367-97b4-c2f1542a53de tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1359 microversion: 2.1 time: 0.290943 Jan 24 22:33:35.492637 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 457/897] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:35 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1359 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:35.524401 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8ba8b552-1c86-4ceb-83cc-0417edffa587 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:35.526071 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8ba8b552-1c86-4ceb-83cc-0417edffa587 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:35.534147 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8ba8b552-1c86-4ceb-83cc-0417edffa587 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:35.534919 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8ba8b552-1c86-4ceb-83cc-0417edffa587 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:35.535972 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8ba8b552-1c86-4ceb-83cc-0417edffa587 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:35.536562 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8ba8b552-1c86-4ceb-83cc-0417edffa587 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:35.620379 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-06c37812-7e25-49b5-bafb-11e7aaaa5cc6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:35.621744 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-06c37812-7e25-49b5-bafb-11e7aaaa5cc6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:35.628123 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-06c37812-7e25-49b5-bafb-11e7aaaa5cc6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:35.628737 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-06c37812-7e25-49b5-bafb-11e7aaaa5cc6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:35.629790 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-06c37812-7e25-49b5-bafb-11e7aaaa5cc6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:35.630302 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-06c37812-7e25-49b5-bafb-11e7aaaa5cc6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:43.743541 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-06c37812-7e25-49b5-bafb-11e7aaaa5cc6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 200 len: 38342 microversion: 2.20 time: 8.127286 Jan 24 22:33:43.744278 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 458/898] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:35 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 38342 bytes in 8129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 22:33:43.749134 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-641137e8-166e-41a5-bcab-95b4d7825c86 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:43.750105 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-641137e8-166e-41a5-bcab-95b4d7825c86 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:43.759196 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-641137e8-166e-41a5-bcab-95b4d7825c86 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:43.759645 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-641137e8-166e-41a5-bcab-95b4d7825c86 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:43.760414 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-641137e8-166e-41a5-bcab-95b4d7825c86 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:43.760843 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-641137e8-166e-41a5-bcab-95b4d7825c86 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:43.786233 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8ba8b552-1c86-4ceb-83cc-0417edffa587 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 36838 microversion: 2.1 time: 8.265879 Jan 24 22:33:43.792469 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 441/899] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:35 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 36838 bytes in 8273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:43.798760 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-67e88044-4004-4caa-8319-af0741591c57 req-6daab331-7cd1-48d0-8f14-eef912081f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1d2298-3059-437a-9f1a-6173d40e21ca", "tag": "4b3048ce-5caa-49ca-82eb-b694366739aa"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:43.802188 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:33:43.802188 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:33:43.812877 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-67e88044-4004-4caa-8319-af0741591c57 req-6daab331-7cd1-48d0-8f14-eef912081f13 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:43.813742 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-67e88044-4004-4caa-8319-af0741591c57 req-6daab331-7cd1-48d0-8f14-eef912081f13 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:43.826301 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-67e88044-4004-4caa-8319-af0741591c57 req-6daab331-7cd1-48d0-8f14-eef912081f13 service nova] Creating event network-changed:4b3048ce-5caa-49ca-82eb-b694366739aa for instance ab1d2298-3059-437a-9f1a-6173d40e21ca on hv-cinder-81322 Jan 24 22:33:43.833528 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-67e88044-4004-4caa-8319-af0741591c57 req-6daab331-7cd1-48d0-8f14-eef912081f13 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038969 Jan 24 22:33:43.834497 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 442/900] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:33:43.840687 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ec28d0af-2ad9-4a14-9107-69ccf538a74b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:43.841666 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ec28d0af-2ad9-4a14-9107-69ccf538a74b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:43.851011 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ec28d0af-2ad9-4a14-9107-69ccf538a74b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:43.851857 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ec28d0af-2ad9-4a14-9107-69ccf538a74b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:43.853185 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ec28d0af-2ad9-4a14-9107-69ccf538a74b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:43.853816 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ec28d0af-2ad9-4a14-9107-69ccf538a74b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:43.883940 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ec28d0af-2ad9-4a14-9107-69ccf538a74b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/ips" status: 200 len: 153 microversion: 2.20 time: 0.047982 Jan 24 22:33:43.885222 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 443/901] 10.222.0.84 () {60 vars in 1288 bytes} [Mon Jan 24 22:33:43 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/ips => generated 153 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:44.005022 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-641137e8-166e-41a5-bcab-95b4d7825c86 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:44.014380 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-641137e8-166e-41a5-bcab-95b4d7825c86 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1359 microversion: 2.1 time: 0.269003 Jan 24 22:33:44.015207 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 459/902] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:43 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1359 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:44.652523 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-57f86cfb-d238-4b6d-9bc3-08882993b487 req-815dc27f-db18-444d-be46-88dbeeb8dcd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbc89f6f-34dd-4831-8df6-a7d8b77c4b46", "tag": "5c4e0fd6-fbad-4f01-a8ef-287b2802e9e6"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:44.654478 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:33:44.654478 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:33:44.669056 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-57f86cfb-d238-4b6d-9bc3-08882993b487 req-815dc27f-db18-444d-be46-88dbeeb8dcd2 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:44.673615 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-57f86cfb-d238-4b6d-9bc3-08882993b487 req-815dc27f-db18-444d-be46-88dbeeb8dcd2 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:44.689308 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-57f86cfb-d238-4b6d-9bc3-08882993b487 req-815dc27f-db18-444d-be46-88dbeeb8dcd2 service nova] Creating event network-changed:5c4e0fd6-fbad-4f01-a8ef-287b2802e9e6 for instance cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 on hv-cinder-81322 Jan 24 22:33:44.696446 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-57f86cfb-d238-4b6d-9bc3-08882993b487 req-815dc27f-db18-444d-be46-88dbeeb8dcd2 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268924 Jan 24 22:33:44.700052 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 444/903] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:33:44.799724 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-cafda7dc-0801-4d34-bc81-7dd81d3cc52d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:44.800787 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-cafda7dc-0801-4d34-bc81-7dd81d3cc52d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:44.807513 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cafda7dc-0801-4d34-bc81-7dd81d3cc52d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:44.807957 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cafda7dc-0801-4d34-bc81-7dd81d3cc52d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:44.808763 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cafda7dc-0801-4d34-bc81-7dd81d3cc52d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:44.809223 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-cafda7dc-0801-4d34-bc81-7dd81d3cc52d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:44.906218 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-cafda7dc-0801-4d34-bc81-7dd81d3cc52d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 38142 microversion: 2.1 time: 0.111226 Jan 24 22:33:44.908133 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 460/904] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:44 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 38142 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:45.033092 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c68d253f-e44c-4f2a-86b8-ffcae2d93ae2 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:45.034033 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c68d253f-e44c-4f2a-86b8-ffcae2d93ae2 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:45.040362 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c68d253f-e44c-4f2a-86b8-ffcae2d93ae2 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:45.040823 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c68d253f-e44c-4f2a-86b8-ffcae2d93ae2 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:45.041620 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c68d253f-e44c-4f2a-86b8-ffcae2d93ae2 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:45.042133 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c68d253f-e44c-4f2a-86b8-ffcae2d93ae2 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:45.177832 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c68d253f-e44c-4f2a-86b8-ffcae2d93ae2 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:45.185330 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c68d253f-e44c-4f2a-86b8-ffcae2d93ae2 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1359 microversion: 2.1 time: 0.156833 Jan 24 22:33:45.186018 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 445/905] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:45 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:45.919171 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-327d734c-8d9c-4496-ab45-25b3fa1786fe tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:45.920209 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-327d734c-8d9c-4496-ab45-25b3fa1786fe tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:45.927786 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-327d734c-8d9c-4496-ab45-25b3fa1786fe tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:45.928233 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-327d734c-8d9c-4496-ab45-25b3fa1786fe tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:45.929026 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-327d734c-8d9c-4496-ab45-25b3fa1786fe tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:45.929474 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-327d734c-8d9c-4496-ab45-25b3fa1786fe tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:46.044480 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-327d734c-8d9c-4496-ab45-25b3fa1786fe tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 38169 microversion: 2.1 time: 0.128889 Jan 24 22:33:46.045408 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 461/906] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:45 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 38169 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:46.204609 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7b502e12-0dcf-4c52-bca2-f50e20580135 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:46.205551 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7b502e12-0dcf-4c52-bca2-f50e20580135 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:46.214680 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7b502e12-0dcf-4c52-bca2-f50e20580135 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:46.215289 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7b502e12-0dcf-4c52-bca2-f50e20580135 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:46.216292 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7b502e12-0dcf-4c52-bca2-f50e20580135 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:46.216894 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7b502e12-0dcf-4c52-bca2-f50e20580135 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:46.236714 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-43ed7b93-bd09-44c6-ab98-9447f4102860 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:46.237354 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-43ed7b93-bd09-44c6-ab98-9447f4102860 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:46.245803 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-43ed7b93-bd09-44c6-ab98-9447f4102860 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:46.246249 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-43ed7b93-bd09-44c6-ab98-9447f4102860 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:46.247024 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-43ed7b93-bd09-44c6-ab98-9447f4102860 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:46.247449 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-43ed7b93-bd09-44c6-ab98-9447f4102860 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:46.279010 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-43ed7b93-bd09-44c6-ab98-9447f4102860 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lazy-loading 'flavor' on Instance uuid ee6f4177-b89c-480a-a278-c470e82b9241 {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:33:46.363692 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7b502e12-0dcf-4c52-bca2-f50e20580135 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:46.371156 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7b502e12-0dcf-4c52-bca2-f50e20580135 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1359 microversion: 2.1 time: 0.171655 Jan 24 22:33:46.371711 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 446/907] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:46 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:46.546907 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-43ed7b93-bd09-44c6-ab98-9447f4102860 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 202 len: 0 microversion: 2.20 time: 0.314123 Jan 24 22:33:46.547525 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 462/908] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:33:46 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:33:46.556414 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-44c68915-d583-47da-812a-4ae8b5fd326f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:46.557225 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-44c68915-d583-47da-812a-4ae8b5fd326f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:46.563151 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-44c68915-d583-47da-812a-4ae8b5fd326f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:46.563594 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-44c68915-d583-47da-812a-4ae8b5fd326f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:46.564525 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-44c68915-d583-47da-812a-4ae8b5fd326f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:46.565235 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-44c68915-d583-47da-812a-4ae8b5fd326f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:46.712573 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-44c68915-d583-47da-812a-4ae8b5fd326f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:46.721218 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-44c68915-d583-47da-812a-4ae8b5fd326f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:46.722640 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-44c68915-d583-47da-812a-4ae8b5fd326f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:46.723801 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-44c68915-d583-47da-812a-4ae8b5fd326f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1725 microversion: 2.20 time: 0.171249 Jan 24 22:33:46.724352 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 447/909] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:33:46 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:33:47.064337 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c41cfa62-8154-44ef-b337-59b38774e8a3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:47.066278 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c41cfa62-8154-44ef-b337-59b38774e8a3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:47.077162 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c41cfa62-8154-44ef-b337-59b38774e8a3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:47.077961 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c41cfa62-8154-44ef-b337-59b38774e8a3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:47.079227 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c41cfa62-8154-44ef-b337-59b38774e8a3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:47.080105 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c41cfa62-8154-44ef-b337-59b38774e8a3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:47.392099 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3aa63536-5732-4db0-b71a-e32508f01df6 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:47.393990 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3aa63536-5732-4db0-b71a-e32508f01df6 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:47.404408 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3aa63536-5732-4db0-b71a-e32508f01df6 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:47.405135 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3aa63536-5732-4db0-b71a-e32508f01df6 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:47.406429 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3aa63536-5732-4db0-b71a-e32508f01df6 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:47.407136 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3aa63536-5732-4db0-b71a-e32508f01df6 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:47.551245 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3aa63536-5732-4db0-b71a-e32508f01df6 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:47.560428 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3aa63536-5732-4db0-b71a-e32508f01df6 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1359 microversion: 2.1 time: 0.174489 Jan 24 22:33:47.561019 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 448/910] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:47 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:47.743245 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-d5b35832-0ae2-4893-83f8-a39770ec1cca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:47.743864 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d5b35832-0ae2-4893-83f8-a39770ec1cca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:47.752300 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d5b35832-0ae2-4893-83f8-a39770ec1cca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:47.752747 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d5b35832-0ae2-4893-83f8-a39770ec1cca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:47.753562 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d5b35832-0ae2-4893-83f8-a39770ec1cca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:47.754002 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d5b35832-0ae2-4893-83f8-a39770ec1cca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:47.895812 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d5b35832-0ae2-4893-83f8-a39770ec1cca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:47.904378 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d5b35832-0ae2-4893-83f8-a39770ec1cca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:47.905925 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d5b35832-0ae2-4893-83f8-a39770ec1cca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:47.907067 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-d5b35832-0ae2-4893-83f8-a39770ec1cca tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1725 microversion: 2.20 time: 0.168401 Jan 24 22:33:47.907623 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 449/911] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:33:47 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:33:48.576889 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1324f932-3122-4353-b2a5-f9eb10b1ddeb tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:48.577607 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-1324f932-3122-4353-b2a5-f9eb10b1ddeb tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:48.584289 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1324f932-3122-4353-b2a5-f9eb10b1ddeb tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:48.584730 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1324f932-3122-4353-b2a5-f9eb10b1ddeb tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:48.585543 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1324f932-3122-4353-b2a5-f9eb10b1ddeb tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:48.585969 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1324f932-3122-4353-b2a5-f9eb10b1ddeb tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:48.722628 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-1324f932-3122-4353-b2a5-f9eb10b1ddeb tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:48.729870 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-1324f932-3122-4353-b2a5-f9eb10b1ddeb tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1359 microversion: 2.1 time: 0.156753 Jan 24 22:33:48.730434 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 450/912] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:48 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:48.929562 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1c728966-1717-47ec-a83c-71ac0e2d0629 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:48.930375 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-1c728966-1717-47ec-a83c-71ac0e2d0629 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:48.939754 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1c728966-1717-47ec-a83c-71ac0e2d0629 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:48.940194 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1c728966-1717-47ec-a83c-71ac0e2d0629 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:48.940957 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1c728966-1717-47ec-a83c-71ac0e2d0629 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:48.941415 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1c728966-1717-47ec-a83c-71ac0e2d0629 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:49.087055 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-1c728966-1717-47ec-a83c-71ac0e2d0629 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:49.095365 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-1c728966-1717-47ec-a83c-71ac0e2d0629 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:49.096712 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-1c728966-1717-47ec-a83c-71ac0e2d0629 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:49.097913 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-1c728966-1717-47ec-a83c-71ac0e2d0629 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1725 microversion: 2.20 time: 0.174288 Jan 24 22:33:49.098446 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 451/913] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:33:48 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:33:49.591062 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c41cfa62-8154-44ef-b337-59b38774e8a3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 38169 microversion: 2.1 time: 2.533949 Jan 24 22:33:49.592509 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 463/914] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:47 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 38169 bytes in 2537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:49.750387 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c27df7e3-e6cf-4277-9be5-37e69dacbcb6 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:49.753213 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c27df7e3-e6cf-4277-9be5-37e69dacbcb6 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:49.758751 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c27df7e3-e6cf-4277-9be5-37e69dacbcb6 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:49.758914 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c27df7e3-e6cf-4277-9be5-37e69dacbcb6 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:49.759713 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c27df7e3-e6cf-4277-9be5-37e69dacbcb6 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:49.760138 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c27df7e3-e6cf-4277-9be5-37e69dacbcb6 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:49.899657 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c27df7e3-e6cf-4277-9be5-37e69dacbcb6 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:49.908633 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c27df7e3-e6cf-4277-9be5-37e69dacbcb6 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1359 microversion: 2.1 time: 0.164759 Jan 24 22:33:49.909740 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 452/915] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:49 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:50.116597 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-dffcf793-b14d-4e54-a0f6-518ca554d5a7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:50.117228 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-dffcf793-b14d-4e54-a0f6-518ca554d5a7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:50.124316 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dffcf793-b14d-4e54-a0f6-518ca554d5a7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:50.124768 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dffcf793-b14d-4e54-a0f6-518ca554d5a7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:50.125568 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dffcf793-b14d-4e54-a0f6-518ca554d5a7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:50.125999 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dffcf793-b14d-4e54-a0f6-518ca554d5a7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:50.263777 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-dffcf793-b14d-4e54-a0f6-518ca554d5a7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:50.271726 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-dffcf793-b14d-4e54-a0f6-518ca554d5a7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:50.273353 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-dffcf793-b14d-4e54-a0f6-518ca554d5a7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:50.274510 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-dffcf793-b14d-4e54-a0f6-518ca554d5a7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1725 microversion: 2.20 time: 0.162230 Jan 24 22:33:50.275079 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 464/916] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:33:50 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:33:50.610143 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-9979e595-52f9-4101-addd-6daf553214d6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:50.611969 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-9979e595-52f9-4101-addd-6daf553214d6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:50.622246 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9979e595-52f9-4101-addd-6daf553214d6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:50.623036 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9979e595-52f9-4101-addd-6daf553214d6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:50.624306 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9979e595-52f9-4101-addd-6daf553214d6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:50.625063 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9979e595-52f9-4101-addd-6daf553214d6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:50.928254 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-48abd1fb-0f38-43a0-bddb-98997b956cb9 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:50.929036 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-48abd1fb-0f38-43a0-bddb-98997b956cb9 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:50.937671 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-48abd1fb-0f38-43a0-bddb-98997b956cb9 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:50.938254 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-48abd1fb-0f38-43a0-bddb-98997b956cb9 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:50.939264 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-48abd1fb-0f38-43a0-bddb-98997b956cb9 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:50.939951 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-48abd1fb-0f38-43a0-bddb-98997b956cb9 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:51.076980 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-48abd1fb-0f38-43a0-bddb-98997b956cb9 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:51.085521 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-48abd1fb-0f38-43a0-bddb-98997b956cb9 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1359 microversion: 2.1 time: 0.162562 Jan 24 22:33:51.086087 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 465/917] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:50 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:51.296709 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b39926e8-204f-4991-8290-0b7bbee0f83e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:51.297872 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b39926e8-204f-4991-8290-0b7bbee0f83e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:51.309004 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b39926e8-204f-4991-8290-0b7bbee0f83e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:51.309797 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b39926e8-204f-4991-8290-0b7bbee0f83e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:51.311075 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b39926e8-204f-4991-8290-0b7bbee0f83e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:51.311792 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b39926e8-204f-4991-8290-0b7bbee0f83e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:51.454034 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b39926e8-204f-4991-8290-0b7bbee0f83e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:51.462498 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b39926e8-204f-4991-8290-0b7bbee0f83e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:51.463911 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b39926e8-204f-4991-8290-0b7bbee0f83e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:51.465095 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b39926e8-204f-4991-8290-0b7bbee0f83e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1725 microversion: 2.20 time: 0.174563 Jan 24 22:33:51.465658 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 466/918] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:33:51 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:33:52.105670 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-21f9622c-6ff7-4f82-9add-b5b7f14bf2f7 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:52.106629 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-21f9622c-6ff7-4f82-9add-b5b7f14bf2f7 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:52.116873 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-21f9622c-6ff7-4f82-9add-b5b7f14bf2f7 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:52.117607 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-21f9622c-6ff7-4f82-9add-b5b7f14bf2f7 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:52.118786 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-21f9622c-6ff7-4f82-9add-b5b7f14bf2f7 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:52.119447 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-21f9622c-6ff7-4f82-9add-b5b7f14bf2f7 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:52.275348 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-21f9622c-6ff7-4f82-9add-b5b7f14bf2f7 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:52.286600 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-21f9622c-6ff7-4f82-9add-b5b7f14bf2f7 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1359 microversion: 2.1 time: 0.186285 Jan 24 22:33:52.287192 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 467/919] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:52 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:52.486667 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0480b49c-7008-4b36-8551-5152dace4c0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:52.487312 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0480b49c-7008-4b36-8551-5152dace4c0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:52.493756 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0480b49c-7008-4b36-8551-5152dace4c0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:52.494210 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0480b49c-7008-4b36-8551-5152dace4c0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:52.494979 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0480b49c-7008-4b36-8551-5152dace4c0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:52.495383 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0480b49c-7008-4b36-8551-5152dace4c0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:52.647220 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0480b49c-7008-4b36-8551-5152dace4c0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:52.655388 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0480b49c-7008-4b36-8551-5152dace4c0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:52.656873 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0480b49c-7008-4b36-8551-5152dace4c0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:52.658060 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0480b49c-7008-4b36-8551-5152dace4c0d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1725 microversion: 2.20 time: 0.177311 Jan 24 22:33:52.658861 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 468/920] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:33:52 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:33:52.909604 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-9979e595-52f9-4101-addd-6daf553214d6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action" status: 200 len: 38300 microversion: 2.1 time: 2.305366 Jan 24 22:33:52.910542 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 453/921] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:33:50 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/action => generated 38300 bytes in 2308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:33:52.920303 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-00c780dc-ea1c-43bc-8433-34268d45f0d4 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:52.920795 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-00c780dc-ea1c-43bc-8433-34268d45f0d4 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:52.927550 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-00c780dc-ea1c-43bc-8433-34268d45f0d4 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:52.927993 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-00c780dc-ea1c-43bc-8433-34268d45f0d4 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:52.928759 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-00c780dc-ea1c-43bc-8433-34268d45f0d4 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:52.929229 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-00c780dc-ea1c-43bc-8433-34268d45f0d4 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:52.952610 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-00c780dc-ea1c-43bc-8433-34268d45f0d4 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/ips" status: 200 len: 147 microversion: 2.1 time: 0.035972 Jan 24 22:33:52.953187 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 469/922] 10.222.0.84 () {58 vars in 1247 bytes} [Mon Jan 24 22:33:52 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:33:53.308141 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-40b7a62b-f926-40c9-83a9-4fafa69309b7 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:53.308837 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-40b7a62b-f926-40c9-83a9-4fafa69309b7 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:53.316459 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-40b7a62b-f926-40c9-83a9-4fafa69309b7 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:53.316911 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-40b7a62b-f926-40c9-83a9-4fafa69309b7 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:53.317737 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-40b7a62b-f926-40c9-83a9-4fafa69309b7 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:53.318178 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-40b7a62b-f926-40c9-83a9-4fafa69309b7 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:53.404457 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-ea196b6a-d2b2-4c59-bd58-eab4ab3d0b3f req-a190519a-48f4-483e-9151-25557f94f2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbc89f6f-34dd-4831-8df6-a7d8b77c4b46", "name": "network-vif-plugged", "status": "completed", "tag": "5c4e0fd6-fbad-4f01-a8ef-287b2802e9e6"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:53.406810 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:33:53.406810 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:33:53.415212 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-ea196b6a-d2b2-4c59-bd58-eab4ab3d0b3f req-a190519a-48f4-483e-9151-25557f94f2e3 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:53.415933 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-ea196b6a-d2b2-4c59-bd58-eab4ab3d0b3f req-a190519a-48f4-483e-9151-25557f94f2e3 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:53.431142 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-ea196b6a-d2b2-4c59-bd58-eab4ab3d0b3f req-a190519a-48f4-483e-9151-25557f94f2e3 service nova] Creating event network-vif-plugged:5c4e0fd6-fbad-4f01-a8ef-287b2802e9e6 for instance cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 on hv-cinder-81322 Jan 24 22:33:53.436458 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-ea196b6a-d2b2-4c59-bd58-eab4ab3d0b3f req-a190519a-48f4-483e-9151-25557f94f2e3 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035644 Jan 24 22:33:53.437424 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 470/923] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:33:53.460252 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-40b7a62b-f926-40c9-83a9-4fafa69309b7 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:53.467661 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-40b7a62b-f926-40c9-83a9-4fafa69309b7 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1359 microversion: 2.1 time: 0.163698 Jan 24 22:33:53.468224 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 454/924] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:53 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:53.678017 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6e02a81b-5e3d-44f6-8328-b192161177ad tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:53.678937 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6e02a81b-5e3d-44f6-8328-b192161177ad tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:53.685414 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6e02a81b-5e3d-44f6-8328-b192161177ad tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:53.685892 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6e02a81b-5e3d-44f6-8328-b192161177ad tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:53.686745 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6e02a81b-5e3d-44f6-8328-b192161177ad tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:53.687247 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6e02a81b-5e3d-44f6-8328-b192161177ad tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:53.819756 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6e02a81b-5e3d-44f6-8328-b192161177ad tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:53.828326 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6e02a81b-5e3d-44f6-8328-b192161177ad tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:53.829860 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6e02a81b-5e3d-44f6-8328-b192161177ad tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:53.831013 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6e02a81b-5e3d-44f6-8328-b192161177ad tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1725 microversion: 2.20 time: 0.157551 Jan 24 22:33:53.831748 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 471/925] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:33:53 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:33:54.282977 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-76c44ec0-3eaa-4573-ba3e-cccdb0e2942a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5444b6dd-cb0d-4894-942d-bbcf7ffb1c34"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:33:54.284025 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-76c44ec0-3eaa-4573-ba3e-cccdb0e2942a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:54.290463 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-76c44ec0-3eaa-4573-ba3e-cccdb0e2942a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:54.290915 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-76c44ec0-3eaa-4573-ba3e-cccdb0e2942a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:54.291688 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-76c44ec0-3eaa-4573-ba3e-cccdb0e2942a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:54.292119 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-76c44ec0-3eaa-4573-ba3e-cccdb0e2942a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:54.485003 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-25a1d888-0e64-4ae6-9f53-789927a41e38 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:54.485581 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-25a1d888-0e64-4ae6-9f53-789927a41e38 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:54.492467 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-25a1d888-0e64-4ae6-9f53-789927a41e38 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:54.492904 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-25a1d888-0e64-4ae6-9f53-789927a41e38 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:54.493694 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-25a1d888-0e64-4ae6-9f53-789927a41e38 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:54.494116 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-25a1d888-0e64-4ae6-9f53-789927a41e38 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:54.576390 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-76c44ec0-3eaa-4573-ba3e-cccdb0e2942a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297008 Jan 24 22:33:54.576934 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 455/926] 10.222.0.84 () {60 vars in 1322 bytes} [Mon Jan 24 22:33:54 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:33:54.643388 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-25a1d888-0e64-4ae6-9f53-789927a41e38 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:54.650978 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-25a1d888-0e64-4ae6-9f53-789927a41e38 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1359 microversion: 2.1 time: 0.169666 Jan 24 22:33:54.651557 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 472/927] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:54 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:54.854172 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-937a3555-1fb1-4fd4-92f1-dc3aeb5faf59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:54.854905 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-937a3555-1fb1-4fd4-92f1-dc3aeb5faf59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:54.862991 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-937a3555-1fb1-4fd4-92f1-dc3aeb5faf59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:54.863548 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-937a3555-1fb1-4fd4-92f1-dc3aeb5faf59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:54.864649 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-937a3555-1fb1-4fd4-92f1-dc3aeb5faf59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:54.865232 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-937a3555-1fb1-4fd4-92f1-dc3aeb5faf59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:55.005604 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-937a3555-1fb1-4fd4-92f1-dc3aeb5faf59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:55.014243 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-937a3555-1fb1-4fd4-92f1-dc3aeb5faf59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:55.015727 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-937a3555-1fb1-4fd4-92f1-dc3aeb5faf59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:55.016882 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-937a3555-1fb1-4fd4-92f1-dc3aeb5faf59 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1725 microversion: 2.20 time: 0.168845 Jan 24 22:33:55.017529 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 456/928] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:33:54 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:33:55.668289 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0535a1b4-9e8c-455f-a132-f8d81587a8de tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:55.669008 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0535a1b4-9e8c-455f-a132-f8d81587a8de tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:55.675919 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0535a1b4-9e8c-455f-a132-f8d81587a8de tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:55.676373 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0535a1b4-9e8c-455f-a132-f8d81587a8de tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:55.677215 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0535a1b4-9e8c-455f-a132-f8d81587a8de tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:55.677643 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0535a1b4-9e8c-455f-a132-f8d81587a8de tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:55.818263 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0535a1b4-9e8c-455f-a132-f8d81587a8de tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:55.826368 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0535a1b4-9e8c-455f-a132-f8d81587a8de tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1359 microversion: 2.1 time: 0.161871 Jan 24 22:33:55.826940 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 473/929] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:55 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:56.039108 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7fa15b46-3ec2-44ce-be50-a55ed2a2399e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:56.040105 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7fa15b46-3ec2-44ce-be50-a55ed2a2399e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:56.050776 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7fa15b46-3ec2-44ce-be50-a55ed2a2399e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:56.051407 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7fa15b46-3ec2-44ce-be50-a55ed2a2399e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:56.052297 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7fa15b46-3ec2-44ce-be50-a55ed2a2399e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:56.052724 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7fa15b46-3ec2-44ce-be50-a55ed2a2399e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:56.199692 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7fa15b46-3ec2-44ce-be50-a55ed2a2399e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:56.207736 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7fa15b46-3ec2-44ce-be50-a55ed2a2399e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:56.209275 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7fa15b46-3ec2-44ce-be50-a55ed2a2399e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:56.210423 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7fa15b46-3ec2-44ce-be50-a55ed2a2399e tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1725 microversion: 2.20 time: 0.177622 Jan 24 22:33:56.211196 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 457/930] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:33:56 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:33:56.847913 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9fdd1311-a29b-4008-8699-b41631afda5c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:56.848913 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9fdd1311-a29b-4008-8699-b41631afda5c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:56.860358 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9fdd1311-a29b-4008-8699-b41631afda5c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:56.861159 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9fdd1311-a29b-4008-8699-b41631afda5c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:56.862458 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9fdd1311-a29b-4008-8699-b41631afda5c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:56.863261 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9fdd1311-a29b-4008-8699-b41631afda5c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:57.001932 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-9fdd1311-a29b-4008-8699-b41631afda5c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:57.013869 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9fdd1311-a29b-4008-8699-b41631afda5c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1359 microversion: 2.1 time: 0.172620 Jan 24 22:33:57.014627 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 474/931] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:56 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:57.229278 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-895bc56a-31aa-4585-be49-ecb04edb4e2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:57.229882 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-895bc56a-31aa-4585-be49-ecb04edb4e2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:57.236485 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-895bc56a-31aa-4585-be49-ecb04edb4e2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:57.237088 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-895bc56a-31aa-4585-be49-ecb04edb4e2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:57.237889 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-895bc56a-31aa-4585-be49-ecb04edb4e2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:57.238353 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-895bc56a-31aa-4585-be49-ecb04edb4e2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:57.383498 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-895bc56a-31aa-4585-be49-ecb04edb4e2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:57.391813 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-895bc56a-31aa-4585-be49-ecb04edb4e2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:57.393729 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-895bc56a-31aa-4585-be49-ecb04edb4e2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:57.394487 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-895bc56a-31aa-4585-be49-ecb04edb4e2c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1725 microversion: 2.20 time: 0.168916 Jan 24 22:33:57.395106 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 458/932] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:33:57 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:33:58.037191 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-046ef2c0-0169-4545-bc75-a50c48c0d311 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:58.037735 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-046ef2c0-0169-4545-bc75-a50c48c0d311 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:58.044562 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-046ef2c0-0169-4545-bc75-a50c48c0d311 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:58.045010 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-046ef2c0-0169-4545-bc75-a50c48c0d311 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:58.045963 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-046ef2c0-0169-4545-bc75-a50c48c0d311 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:58.046395 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-046ef2c0-0169-4545-bc75-a50c48c0d311 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:58.187904 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-046ef2c0-0169-4545-bc75-a50c48c0d311 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:58.198451 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-046ef2c0-0169-4545-bc75-a50c48c0d311 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1548 microversion: 2.1 time: 0.167903 Jan 24 22:33:58.199213 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 475/933] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:58 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:58.217321 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c0afbf34-45f3-4ad1-a6cd-b2ca8f3b6a89 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:58.217862 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c0afbf34-45f3-4ad1-a6cd-b2ca8f3b6a89 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:58.224234 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c0afbf34-45f3-4ad1-a6cd-b2ca8f3b6a89 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:58.224695 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c0afbf34-45f3-4ad1-a6cd-b2ca8f3b6a89 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:58.225478 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c0afbf34-45f3-4ad1-a6cd-b2ca8f3b6a89 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:58.225904 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c0afbf34-45f3-4ad1-a6cd-b2ca8f3b6a89 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:58.362099 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c0afbf34-45f3-4ad1-a6cd-b2ca8f3b6a89 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:58.369869 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c0afbf34-45f3-4ad1-a6cd-b2ca8f3b6a89 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1548 microversion: 2.1 time: 0.156236 Jan 24 22:33:58.370526 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 459/934] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:58 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:33:58.385435 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6e3ae6d2-576f-4bf3-825a-f5799faa2950 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:58.395895 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:33:58.395895 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:33:58.397011 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6e3ae6d2-576f-4bf3-825a-f5799faa2950 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:58.397772 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6e3ae6d2-576f-4bf3-825a-f5799faa2950 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Searching by: {'deleted': False, 'project_id': '87f09686992a4d389c166bb0f9704e4c'} {{(pid=116467) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 24 22:33:58.405228 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6e3ae6d2-576f-4bf3-825a-f5799faa2950 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:58.405671 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6e3ae6d2-576f-4bf3-825a-f5799faa2950 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:58.406598 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6e3ae6d2-576f-4bf3-825a-f5799faa2950 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:58.406902 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6e3ae6d2-576f-4bf3-825a-f5799faa2950 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:58.412779 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-65987dd8-7731-4002-ad54-8f78638b856b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:58.413723 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-65987dd8-7731-4002-ad54-8f78638b856b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:58.420570 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-65987dd8-7731-4002-ad54-8f78638b856b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:58.420869 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-65987dd8-7731-4002-ad54-8f78638b856b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:58.421693 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-65987dd8-7731-4002-ad54-8f78638b856b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:58.422145 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-65987dd8-7731-4002-ad54-8f78638b856b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:58.500610 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.multi_cell_list [None req-6e3ae6d2-576f-4bf3-825a-f5799faa2950 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116467) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 24 22:33:58.584438 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-65987dd8-7731-4002-ad54-8f78638b856b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:58.597087 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-65987dd8-7731-4002-ad54-8f78638b856b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:58.598810 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-65987dd8-7731-4002-ad54-8f78638b856b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:58.599993 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-65987dd8-7731-4002-ad54-8f78638b856b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1725 microversion: 2.20 time: 0.191221 Jan 24 22:33:58.600744 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 460/935] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:33:58 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:33:58.605070 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6e3ae6d2-576f-4bf3-825a-f5799faa2950 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.223233 Jan 24 22:33:58.605644 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 476/936] 10.222.0.84 () {58 vars in 1124 bytes} [Mon Jan 24 22:33:58 2022] GET /compute/v2.1/servers => generated 343 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:33:58.615449 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-5e182420-acc2-47e0-b5cb-6505a3eb4790 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:58.616057 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-5e182420-acc2-47e0-b5cb-6505a3eb4790 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:58.621905 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5e182420-acc2-47e0-b5cb-6505a3eb4790 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:58.622356 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5e182420-acc2-47e0-b5cb-6505a3eb4790 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:58.623300 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5e182420-acc2-47e0-b5cb-6505a3eb4790 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:58.623731 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5e182420-acc2-47e0-b5cb-6505a3eb4790 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:58.752292 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-5e182420-acc2-47e0-b5cb-6505a3eb4790 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:58.760171 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-5e182420-acc2-47e0-b5cb-6505a3eb4790 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1548 microversion: 2.1 time: 0.148382 Jan 24 22:33:58.761057 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 461/937] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:33:58 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:33:59.627247 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-06c96c0e-ebbc-4572-8db9-7a18fcb7104c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:33:59.628006 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-06c96c0e-ebbc-4572-8db9-7a18fcb7104c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:33:59.635802 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-06c96c0e-ebbc-4572-8db9-7a18fcb7104c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:59.636256 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-06c96c0e-ebbc-4572-8db9-7a18fcb7104c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:59.637032 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-06c96c0e-ebbc-4572-8db9-7a18fcb7104c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:33:59.637496 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-06c96c0e-ebbc-4572-8db9-7a18fcb7104c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:33:59.771238 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-06c96c0e-ebbc-4572-8db9-7a18fcb7104c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:59.779045 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-06c96c0e-ebbc-4572-8db9-7a18fcb7104c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:59.780529 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-06c96c0e-ebbc-4572-8db9-7a18fcb7104c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:33:59.781717 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-06c96c0e-ebbc-4572-8db9-7a18fcb7104c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1725 microversion: 2.20 time: 0.160796 Jan 24 22:33:59.782283 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 477/938] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:33:59 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:00.289155 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a28340a3-659c-43ac-befb-f9e6caed4672 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d0ee76b-2b62-4547-8545-857a18f50903"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:34:00.290312 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a28340a3-659c-43ac-befb-f9e6caed4672 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:00.296488 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a28340a3-659c-43ac-befb-f9e6caed4672 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:00.296927 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a28340a3-659c-43ac-befb-f9e6caed4672 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:00.297735 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a28340a3-659c-43ac-befb-f9e6caed4672 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:00.298159 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a28340a3-659c-43ac-befb-f9e6caed4672 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:00.596542 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a28340a3-659c-43ac-befb-f9e6caed4672 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "POST /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311069 Jan 24 22:34:00.597450 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 462/939] 10.222.0.84 () {60 vars in 1322 bytes} [Mon Jan 24 22:34:00 2022] POST /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:00.806865 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0adc3432-3631-427a-b054-8326cf3ad9f3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:00.807419 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0adc3432-3631-427a-b054-8326cf3ad9f3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:00.816343 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0adc3432-3631-427a-b054-8326cf3ad9f3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:00.817113 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0adc3432-3631-427a-b054-8326cf3ad9f3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:00.818036 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0adc3432-3631-427a-b054-8326cf3ad9f3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:00.818459 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0adc3432-3631-427a-b054-8326cf3ad9f3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:00.950615 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0adc3432-3631-427a-b054-8326cf3ad9f3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:00.959037 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0adc3432-3631-427a-b054-8326cf3ad9f3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:00.960529 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0adc3432-3631-427a-b054-8326cf3ad9f3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:00.961699 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0adc3432-3631-427a-b054-8326cf3ad9f3 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1725 microversion: 2.20 time: 0.158937 Jan 24 22:34:00.962256 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 478/940] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:00 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:01.980771 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-563d7b5c-301e-40c6-b6af-c7ef65012408 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:01.981508 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-563d7b5c-301e-40c6-b6af-c7ef65012408 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:01.988869 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-563d7b5c-301e-40c6-b6af-c7ef65012408 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:01.989372 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-563d7b5c-301e-40c6-b6af-c7ef65012408 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:01.990318 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-563d7b5c-301e-40c6-b6af-c7ef65012408 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:01.990751 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-563d7b5c-301e-40c6-b6af-c7ef65012408 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:02.127837 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-563d7b5c-301e-40c6-b6af-c7ef65012408 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:02.140950 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-563d7b5c-301e-40c6-b6af-c7ef65012408 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:02.143328 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-563d7b5c-301e-40c6-b6af-c7ef65012408 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:02.145184 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-563d7b5c-301e-40c6-b6af-c7ef65012408 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1725 microversion: 2.20 time: 0.168539 Jan 24 22:34:02.146051 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 463/941] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:01 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:03.166016 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-835e6052-fb58-4232-855a-efa77fbe69d7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:03.166667 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-835e6052-fb58-4232-855a-efa77fbe69d7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:03.174448 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-835e6052-fb58-4232-855a-efa77fbe69d7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:03.174972 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-835e6052-fb58-4232-855a-efa77fbe69d7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:03.175871 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-835e6052-fb58-4232-855a-efa77fbe69d7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:03.176371 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-835e6052-fb58-4232-855a-efa77fbe69d7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:03.319008 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-835e6052-fb58-4232-855a-efa77fbe69d7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:03.326948 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-835e6052-fb58-4232-855a-efa77fbe69d7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:03.328421 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-835e6052-fb58-4232-855a-efa77fbe69d7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:03.329594 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-835e6052-fb58-4232-855a-efa77fbe69d7 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1746 microversion: 2.20 time: 0.168488 Jan 24 22:34:03.330159 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 479/942] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:03 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:04.198339 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-da1b9b79-e357-4a40-89ee-9b68c097c60e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:04.199365 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-da1b9b79-e357-4a40-89ee-9b68c097c60e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:04.206479 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-da1b9b79-e357-4a40-89ee-9b68c097c60e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:04.206932 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-da1b9b79-e357-4a40-89ee-9b68c097c60e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:04.207745 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-da1b9b79-e357-4a40-89ee-9b68c097c60e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:04.208182 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-da1b9b79-e357-4a40-89ee-9b68c097c60e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:04.240635 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-da1b9b79-e357-4a40-89ee-9b68c097c60e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046219 Jan 24 22:34:04.241329 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 464/943] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:34:04 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:04.251353 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-8dd2e53d-636e-45f2-86c4-e30cd4a07845 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:04.251969 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-8dd2e53d-636e-45f2-86c4-e30cd4a07845 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:04.259435 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8dd2e53d-636e-45f2-86c4-e30cd4a07845 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:04.259835 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8dd2e53d-636e-45f2-86c4-e30cd4a07845 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:04.260816 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8dd2e53d-636e-45f2-86c4-e30cd4a07845 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:04.261269 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-8dd2e53d-636e-45f2-86c4-e30cd4a07845 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:04.352849 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3db44575-8a38-46d1-8d91-57eaf21f5dd6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:04.353982 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3db44575-8a38-46d1-8d91-57eaf21f5dd6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:04.366098 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3db44575-8a38-46d1-8d91-57eaf21f5dd6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:04.367123 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3db44575-8a38-46d1-8d91-57eaf21f5dd6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:04.368397 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3db44575-8a38-46d1-8d91-57eaf21f5dd6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:04.369127 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3db44575-8a38-46d1-8d91-57eaf21f5dd6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:04.460656 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-8dd2e53d-636e-45f2-86c4-e30cd4a07845 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments/5444b6dd-cb0d-4894-942d-bbcf7ffb1c34" status: 200 len: 194 microversion: 2.1 time: 0.213136 Jan 24 22:34:04.461271 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 480/944] 10.222.0.84 () {58 vars in 1412 bytes} [Mon Jan 24 22:34:04 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments/5444b6dd-cb0d-4894-942d-bbcf7ffb1c34 => generated 194 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:04.512243 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3db44575-8a38-46d1-8d91-57eaf21f5dd6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:04.520450 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3db44575-8a38-46d1-8d91-57eaf21f5dd6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:04.522178 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3db44575-8a38-46d1-8d91-57eaf21f5dd6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:04.523577 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3db44575-8a38-46d1-8d91-57eaf21f5dd6 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1746 microversion: 2.20 time: 0.177494 Jan 24 22:34:04.524259 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 465/945] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:04 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1746 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:05.471932 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-e0879d1b-6e0e-43a4-a3bf-698a8ea146f2 req-3547511d-7f9f-4f5e-a041-6c5a58f5a90b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6f4177-b89c-480a-a278-c470e82b9241", "name": "network-vif-plugged", "status": "completed", "tag": "b98d14cd-7266-457a-b737-02c742f241f8"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:34:05.473463 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:34:05.473463 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:34:05.481447 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-e0879d1b-6e0e-43a4-a3bf-698a8ea146f2 req-3547511d-7f9f-4f5e-a041-6c5a58f5a90b service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:05.482150 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-e0879d1b-6e0e-43a4-a3bf-698a8ea146f2 req-3547511d-7f9f-4f5e-a041-6c5a58f5a90b service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:05.495416 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-e0879d1b-6e0e-43a4-a3bf-698a8ea146f2 req-3547511d-7f9f-4f5e-a041-6c5a58f5a90b service nova] Creating event network-vif-plugged:b98d14cd-7266-457a-b737-02c742f241f8 for instance ee6f4177-b89c-480a-a278-c470e82b9241 on hv-cinder-81322 Jan 24 22:34:05.500536 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-e0879d1b-6e0e-43a4-a3bf-698a8ea146f2 req-3547511d-7f9f-4f5e-a041-6c5a58f5a90b service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032283 Jan 24 22:34:05.502725 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 481/946] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:05.545065 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3ff3ae1f-dded-4aca-82fd-2ce619b8ca0c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:05.546313 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3ff3ae1f-dded-4aca-82fd-2ce619b8ca0c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:05.554277 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3ff3ae1f-dded-4aca-82fd-2ce619b8ca0c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:05.555058 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3ff3ae1f-dded-4aca-82fd-2ce619b8ca0c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:05.556029 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3ff3ae1f-dded-4aca-82fd-2ce619b8ca0c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:05.556622 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3ff3ae1f-dded-4aca-82fd-2ce619b8ca0c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:05.712771 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3ff3ae1f-dded-4aca-82fd-2ce619b8ca0c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:05.721264 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3ff3ae1f-dded-4aca-82fd-2ce619b8ca0c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:05.723096 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3ff3ae1f-dded-4aca-82fd-2ce619b8ca0c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:05.724566 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3ff3ae1f-dded-4aca-82fd-2ce619b8ca0c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1741 microversion: 2.20 time: 0.186126 Jan 24 22:34:05.725443 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 466/947] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:05 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:34:05.805484 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-fe1b33b2-3c0d-4d32-bc50-99ef3616b23e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d675baa-35ed-4d30-a493-3265d2dd468e"}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:34:05.806698 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-fe1b33b2-3c0d-4d32-bc50-99ef3616b23e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:05.813107 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fe1b33b2-3c0d-4d32-bc50-99ef3616b23e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:05.814004 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fe1b33b2-3c0d-4d32-bc50-99ef3616b23e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:05.815477 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fe1b33b2-3c0d-4d32-bc50-99ef3616b23e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:05.815908 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fe1b33b2-3c0d-4d32-bc50-99ef3616b23e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:06.136524 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-fe1b33b2-3c0d-4d32-bc50-99ef3616b23e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335377 Jan 24 22:34:06.137421 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 482/948] 10.222.0.84 () {60 vars in 1322 bytes} [Mon Jan 24 22:34:05 2022] POST /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:34:06.744260 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6406f865-4e2f-4454-87ac-45fe55fecfc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:06.745558 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6406f865-4e2f-4454-87ac-45fe55fecfc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:06.752224 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6406f865-4e2f-4454-87ac-45fe55fecfc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:06.752673 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6406f865-4e2f-4454-87ac-45fe55fecfc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:06.756634 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6406f865-4e2f-4454-87ac-45fe55fecfc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:06.757350 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6406f865-4e2f-4454-87ac-45fe55fecfc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:06.985811 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-6406f865-4e2f-4454-87ac-45fe55fecfc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:06.995643 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-6406f865-4e2f-4454-87ac-45fe55fecfc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:06.998747 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-6406f865-4e2f-4454-87ac-45fe55fecfc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:06.999963 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6406f865-4e2f-4454-87ac-45fe55fecfc2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1741 microversion: 2.20 time: 0.259517 Jan 24 22:34:07.000649 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 467/949] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:06 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1741 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:08.019593 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2ef7ff68-a70b-4117-9f07-cd1676d89819 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:08.020860 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2ef7ff68-a70b-4117-9f07-cd1676d89819 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:08.027585 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2ef7ff68-a70b-4117-9f07-cd1676d89819 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:08.028263 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2ef7ff68-a70b-4117-9f07-cd1676d89819 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:08.029272 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2ef7ff68-a70b-4117-9f07-cd1676d89819 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:08.029862 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2ef7ff68-a70b-4117-9f07-cd1676d89819 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:08.173008 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2ef7ff68-a70b-4117-9f07-cd1676d89819 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:08.182292 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2ef7ff68-a70b-4117-9f07-cd1676d89819 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:08.183789 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2ef7ff68-a70b-4117-9f07-cd1676d89819 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:08.184966 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2ef7ff68-a70b-4117-9f07-cd1676d89819 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1741 microversion: 2.20 time: 0.170016 Jan 24 22:34:08.185554 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 483/950] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:08 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:09.203011 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-979e49bd-8d2e-4c84-a5e1-18eb16908edd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:09.203798 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-979e49bd-8d2e-4c84-a5e1-18eb16908edd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:09.211344 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-979e49bd-8d2e-4c84-a5e1-18eb16908edd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:09.211864 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-979e49bd-8d2e-4c84-a5e1-18eb16908edd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:09.212978 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-979e49bd-8d2e-4c84-a5e1-18eb16908edd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:09.213444 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-979e49bd-8d2e-4c84-a5e1-18eb16908edd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:09.367751 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-979e49bd-8d2e-4c84-a5e1-18eb16908edd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:09.376431 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-979e49bd-8d2e-4c84-a5e1-18eb16908edd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:09.378159 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-979e49bd-8d2e-4c84-a5e1-18eb16908edd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:09.379352 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-979e49bd-8d2e-4c84-a5e1-18eb16908edd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1741 microversion: 2.20 time: 0.180130 Jan 24 22:34:09.379943 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 468/951] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:09 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:34:10.398170 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b8dcf8aa-d264-46e0-9b51-471fa4a1298f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:10.399099 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b8dcf8aa-d264-46e0-9b51-471fa4a1298f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:10.406396 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b8dcf8aa-d264-46e0-9b51-471fa4a1298f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:10.407055 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b8dcf8aa-d264-46e0-9b51-471fa4a1298f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:10.408067 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b8dcf8aa-d264-46e0-9b51-471fa4a1298f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:10.408475 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b8dcf8aa-d264-46e0-9b51-471fa4a1298f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:10.565426 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b8dcf8aa-d264-46e0-9b51-471fa4a1298f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:10.574184 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b8dcf8aa-d264-46e0-9b51-471fa4a1298f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:10.575695 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b8dcf8aa-d264-46e0-9b51-471fa4a1298f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:10.576925 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b8dcf8aa-d264-46e0-9b51-471fa4a1298f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1741 microversion: 2.20 time: 0.182500 Jan 24 22:34:10.577525 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 484/952] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:10 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:11.384318 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-fd5b101b-4b69-4aef-ab91-a4712d2a660a tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:11.385601 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-fd5b101b-4b69-4aef-ab91-a4712d2a660a tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:11.393459 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fd5b101b-4b69-4aef-ab91-a4712d2a660a tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:11.393987 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fd5b101b-4b69-4aef-ab91-a4712d2a660a tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:11.395001 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fd5b101b-4b69-4aef-ab91-a4712d2a660a tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:11.395467 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fd5b101b-4b69-4aef-ab91-a4712d2a660a tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:11.595802 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0a10b768-207e-45e9-bf6d-217822ca91b2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:11.597233 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0a10b768-207e-45e9-bf6d-217822ca91b2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:11.604954 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0a10b768-207e-45e9-bf6d-217822ca91b2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:11.605432 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0a10b768-207e-45e9-bf6d-217822ca91b2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:11.606765 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0a10b768-207e-45e9-bf6d-217822ca91b2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:11.607356 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0a10b768-207e-45e9-bf6d-217822ca91b2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:11.786210 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-fd5b101b-4b69-4aef-ab91-a4712d2a660a tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:11.795179 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-fd5b101b-4b69-4aef-ab91-a4712d2a660a tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1594 microversion: 2.1 time: 0.414817 Jan 24 22:34:11.796008 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 469/953] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:11 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1594 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:34:11.860749 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0a10b768-207e-45e9-bf6d-217822ca91b2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:11.869102 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0a10b768-207e-45e9-bf6d-217822ca91b2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:11.870615 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0a10b768-207e-45e9-bf6d-217822ca91b2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:11.871840 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0a10b768-207e-45e9-bf6d-217822ca91b2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1741 microversion: 2.20 time: 0.280159 Jan 24 22:34:11.877161 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 485/954] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:11 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1741 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:34:12.890950 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1e2be596-b6b1-4775-85f1-9e3183a1ce20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:12.892146 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-1e2be596-b6b1-4775-85f1-9e3183a1ce20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:12.899606 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1e2be596-b6b1-4775-85f1-9e3183a1ce20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:12.900383 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1e2be596-b6b1-4775-85f1-9e3183a1ce20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:12.901534 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1e2be596-b6b1-4775-85f1-9e3183a1ce20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:12.903065 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1e2be596-b6b1-4775-85f1-9e3183a1ce20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:13.124014 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-1e2be596-b6b1-4775-85f1-9e3183a1ce20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:13.133554 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-1e2be596-b6b1-4775-85f1-9e3183a1ce20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:13.135327 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-1e2be596-b6b1-4775-85f1-9e3183a1ce20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:13.136678 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-1e2be596-b6b1-4775-85f1-9e3183a1ce20 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1741 microversion: 2.20 time: 0.249596 Jan 24 22:34:13.137924 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 470/955] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:12 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1741 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:14.157782 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4626e2e4-f5a2-457b-98ed-b6d736af0b75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:14.158653 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4626e2e4-f5a2-457b-98ed-b6d736af0b75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:14.167844 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4626e2e4-f5a2-457b-98ed-b6d736af0b75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:14.173985 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-af3fb13e-f520-4fc4-a1ea-d9e53cdd5b20 req-53294378-5232-40ea-817c-f69acebe6a50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbc89f6f-34dd-4831-8df6-a7d8b77c4b46", "tag": "5c4e0fd6-fbad-4f01-a8ef-287b2802e9e6"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:34:14.176438 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:34:14.176438 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:34:14.180835 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4626e2e4-f5a2-457b-98ed-b6d736af0b75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:14.182311 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4626e2e4-f5a2-457b-98ed-b6d736af0b75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:14.184853 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4626e2e4-f5a2-457b-98ed-b6d736af0b75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:14.195294 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-af3fb13e-f520-4fc4-a1ea-d9e53cdd5b20 req-53294378-5232-40ea-817c-f69acebe6a50 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:14.196296 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-af3fb13e-f520-4fc4-a1ea-d9e53cdd5b20 req-53294378-5232-40ea-817c-f69acebe6a50 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:14.225298 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-af3fb13e-f520-4fc4-a1ea-d9e53cdd5b20 req-53294378-5232-40ea-817c-f69acebe6a50 service nova] Creating event network-changed:5c4e0fd6-fbad-4f01-a8ef-287b2802e9e6 for instance cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 on hv-cinder-81322 Jan 24 22:34:14.237547 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-af3fb13e-f520-4fc4-a1ea-d9e53cdd5b20 req-53294378-5232-40ea-817c-f69acebe6a50 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067197 Jan 24 22:34:14.239059 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 471/956] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:34:14.392504 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4626e2e4-f5a2-457b-98ed-b6d736af0b75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:14.401891 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4626e2e4-f5a2-457b-98ed-b6d736af0b75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:14.403828 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4626e2e4-f5a2-457b-98ed-b6d736af0b75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:14.405349 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4626e2e4-f5a2-457b-98ed-b6d736af0b75 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1741 microversion: 2.20 time: 0.251562 Jan 24 22:34:14.405779 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 486/957] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:14 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1741 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:15.324962 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-9baab17a-7af5-4453-8b95-bb1e954e16e4 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-420703410"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:34:15.325659 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-9baab17a-7af5-4453-8b95-bb1e954e16e4 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:15.332049 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9baab17a-7af5-4453-8b95-bb1e954e16e4 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:15.332389 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9baab17a-7af5-4453-8b95-bb1e954e16e4 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:15.333202 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9baab17a-7af5-4453-8b95-bb1e954e16e4 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:15.333898 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9baab17a-7af5-4453-8b95-bb1e954e16e4 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:15.423158 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a7770230-424f-4404-9847-a139732e4c24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:15.424529 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a7770230-424f-4404-9847-a139732e4c24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:15.434635 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a7770230-424f-4404-9847-a139732e4c24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:15.436233 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a7770230-424f-4404-9847-a139732e4c24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:15.437304 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a7770230-424f-4404-9847-a139732e4c24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:15.437945 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a7770230-424f-4404-9847-a139732e4c24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:15.475136 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.network.security_group_api [None req-9baab17a-7af5-4453-8b95-bb1e954e16e4 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Adding security group 25f4cdc4-62bd-43d7-94b9-79cc4611a1c5 to port 5c4e0fd6-fbad-4f01-a8ef-287b2802e9e6 Jan 24 22:34:15.670605 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a7770230-424f-4404-9847-a139732e4c24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:15.678953 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a7770230-424f-4404-9847-a139732e4c24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:15.680735 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a7770230-424f-4404-9847-a139732e4c24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:15.681928 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a7770230-424f-4404-9847-a139732e4c24 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1723 microversion: 2.20 time: 0.262459 Jan 24 22:34:15.682641 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 487/958] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:15 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:34:15.905610 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-9baab17a-7af5-4453-8b95-bb1e954e16e4 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "POST /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/action" status: 202 len: 0 microversion: 2.1 time: 0.585102 Jan 24 22:34:15.906627 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 472/959] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:34:15 2022] POST /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:34:15.914784 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-80031b2e-906e-4877-92b7-86d1061a0db2 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:15.915429 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-80031b2e-906e-4877-92b7-86d1061a0db2 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:15.921896 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-80031b2e-906e-4877-92b7-86d1061a0db2 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:15.922262 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-80031b2e-906e-4877-92b7-86d1061a0db2 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:15.923040 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-80031b2e-906e-4877-92b7-86d1061a0db2 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:15.927465 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-80031b2e-906e-4877-92b7-86d1061a0db2 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:16.087777 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-80031b2e-906e-4877-92b7-86d1061a0db2 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:16.097305 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-80031b2e-906e-4877-92b7-86d1061a0db2 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1759 microversion: 2.1 time: 0.186239 Jan 24 22:34:16.097964 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 488/960] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:15 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1759 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:34:16.258741 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-a971c7c9-e1ee-4e06-bf41-2574bd376a10 req-c4e74e48-1e58-485c-a2f2-f0dd253532d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbc89f6f-34dd-4831-8df6-a7d8b77c4b46", "tag": "5c4e0fd6-fbad-4f01-a8ef-287b2802e9e6"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:34:16.260576 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:34:16.260576 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:34:16.267928 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-a971c7c9-e1ee-4e06-bf41-2574bd376a10 req-c4e74e48-1e58-485c-a2f2-f0dd253532d0 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:16.268507 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-a971c7c9-e1ee-4e06-bf41-2574bd376a10 req-c4e74e48-1e58-485c-a2f2-f0dd253532d0 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:16.279398 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-a971c7c9-e1ee-4e06-bf41-2574bd376a10 req-c4e74e48-1e58-485c-a2f2-f0dd253532d0 service nova] Creating event network-changed:5c4e0fd6-fbad-4f01-a8ef-287b2802e9e6 for instance cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 on hv-cinder-81322 Jan 24 22:34:16.284205 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-a971c7c9-e1ee-4e06-bf41-2574bd376a10 req-c4e74e48-1e58-485c-a2f2-f0dd253532d0 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031722 Jan 24 22:34:16.284785 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 473/961] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:16.700924 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-06a76435-141c-47f8-ab00-357c85de4679 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:16.701643 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-06a76435-141c-47f8-ab00-357c85de4679 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:16.709035 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-06a76435-141c-47f8-ab00-357c85de4679 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:16.709485 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-06a76435-141c-47f8-ab00-357c85de4679 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:16.710289 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-06a76435-141c-47f8-ab00-357c85de4679 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:16.710720 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-06a76435-141c-47f8-ab00-357c85de4679 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:16.849963 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-06a76435-141c-47f8-ab00-357c85de4679 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:16.857923 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-06a76435-141c-47f8-ab00-357c85de4679 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:16.859384 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-06a76435-141c-47f8-ab00-357c85de4679 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:16.860523 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-06a76435-141c-47f8-ab00-357c85de4679 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1723 microversion: 2.20 time: 0.163511 Jan 24 22:34:16.861096 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 489/962] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:16 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:17.479268 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-4071ec6a-4d78-4a1c-9f63-752e1a6e7f57 req-6d7cd491-a944-4547-bf29-55f0ec2e5cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6f4177-b89c-480a-a278-c470e82b9241", "name": "network-vif-unplugged", "status": "completed", "tag": "b98d14cd-7266-457a-b737-02c742f241f8"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:34:17.480721 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:34:17.480721 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:34:17.488077 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-4071ec6a-4d78-4a1c-9f63-752e1a6e7f57 req-6d7cd491-a944-4547-bf29-55f0ec2e5cdd service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:17.488542 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-4071ec6a-4d78-4a1c-9f63-752e1a6e7f57 req-6d7cd491-a944-4547-bf29-55f0ec2e5cdd service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:17.500032 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-4071ec6a-4d78-4a1c-9f63-752e1a6e7f57 req-6d7cd491-a944-4547-bf29-55f0ec2e5cdd service nova] Creating event network-vif-unplugged:b98d14cd-7266-457a-b737-02c742f241f8 for instance ee6f4177-b89c-480a-a278-c470e82b9241 on hv-cinder-81322 Jan 24 22:34:17.504778 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-4071ec6a-4d78-4a1c-9f63-752e1a6e7f57 req-6d7cd491-a944-4547-bf29-55f0ec2e5cdd service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030042 Jan 24 22:34:17.505908 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 474/963] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:17.878683 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ffde0b47-71cd-4cf8-9e10-1c09db86b737 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:17.879238 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ffde0b47-71cd-4cf8-9e10-1c09db86b737 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:17.886382 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ffde0b47-71cd-4cf8-9e10-1c09db86b737 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:17.886837 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ffde0b47-71cd-4cf8-9e10-1c09db86b737 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:17.887607 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ffde0b47-71cd-4cf8-9e10-1c09db86b737 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:17.888040 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ffde0b47-71cd-4cf8-9e10-1c09db86b737 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:18.056892 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ffde0b47-71cd-4cf8-9e10-1c09db86b737 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:18.066399 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ffde0b47-71cd-4cf8-9e10-1c09db86b737 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:18.067840 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ffde0b47-71cd-4cf8-9e10-1c09db86b737 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:18.069539 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ffde0b47-71cd-4cf8-9e10-1c09db86b737 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1723 microversion: 2.20 time: 0.194638 Jan 24 22:34:18.070084 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 490/964] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:17 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:18.973904 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a4566b65-00ea-418a-9af6-eebdb1f9b685 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:18.975040 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a4566b65-00ea-418a-9af6-eebdb1f9b685 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:18.984675 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a4566b65-00ea-418a-9af6-eebdb1f9b685 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:18.985159 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a4566b65-00ea-418a-9af6-eebdb1f9b685 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:18.985941 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a4566b65-00ea-418a-9af6-eebdb1f9b685 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:18.986374 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a4566b65-00ea-418a-9af6-eebdb1f9b685 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:19.027400 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a4566b65-00ea-418a-9af6-eebdb1f9b685 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057549 Jan 24 22:34:19.028222 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 475/965] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:34:18 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:19.088220 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-336be881-9c5d-4c8b-93de-d3227628b0b0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:19.089032 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-336be881-9c5d-4c8b-93de-d3227628b0b0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:19.095670 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-336be881-9c5d-4c8b-93de-d3227628b0b0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:19.096118 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-336be881-9c5d-4c8b-93de-d3227628b0b0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:19.097091 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-336be881-9c5d-4c8b-93de-d3227628b0b0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:19.097516 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-336be881-9c5d-4c8b-93de-d3227628b0b0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:19.260449 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-336be881-9c5d-4c8b-93de-d3227628b0b0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:19.269954 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-336be881-9c5d-4c8b-93de-d3227628b0b0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:19.271896 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-336be881-9c5d-4c8b-93de-d3227628b0b0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:19.273535 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-336be881-9c5d-4c8b-93de-d3227628b0b0 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1666 microversion: 2.20 time: 0.189265 Jan 24 22:34:19.274100 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 491/966] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:19 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1666 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:19.293694 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-9b301dfa-05c9-4ae1-b369-42027d93b807 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "870ba125-0219-4fae-885a-931626605019"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:34:19.294711 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-9b301dfa-05c9-4ae1-b369-42027d93b807 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:19.298325 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9a42a8e3-3b41-4e88-989e-80f6be54258c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:19.298815 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9a42a8e3-3b41-4e88-989e-80f6be54258c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:19.301133 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9b301dfa-05c9-4ae1-b369-42027d93b807 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:19.301584 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9b301dfa-05c9-4ae1-b369-42027d93b807 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:19.302363 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9b301dfa-05c9-4ae1-b369-42027d93b807 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:19.302789 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9b301dfa-05c9-4ae1-b369-42027d93b807 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:19.305384 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9a42a8e3-3b41-4e88-989e-80f6be54258c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:19.305833 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9a42a8e3-3b41-4e88-989e-80f6be54258c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:19.306718 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9a42a8e3-3b41-4e88-989e-80f6be54258c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:19.307201 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9a42a8e3-3b41-4e88-989e-80f6be54258c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:19.337767 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9a42a8e3-3b41-4e88-989e-80f6be54258c tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments/5444b6dd-cb0d-4894-942d-bbcf7ffb1c34" status: 200 len: 194 microversion: 2.1 time: 0.043502 Jan 24 22:34:19.338763 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 492/967] 10.222.0.84 () {58 vars in 1412 bytes} [Mon Jan 24 22:34:19 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments/5444b6dd-cb0d-4894-942d-bbcf7ffb1c34 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:19.350725 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-7550391c-9409-4653-9116-565753954618 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:19.351267 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-7550391c-9409-4653-9116-565753954618 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:19.359960 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7550391c-9409-4653-9116-565753954618 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:19.360421 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7550391c-9409-4653-9116-565753954618 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:19.361524 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7550391c-9409-4653-9116-565753954618 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:19.362383 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7550391c-9409-4653-9116-565753954618 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:19.463472 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-7550391c-9409-4653-9116-565753954618 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lazy-loading 'services' on Instance uuid 4d98aba3-4e1a-4acd-9aff-582acd7e2322 {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:34:19.556032 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-7550391c-9409-4653-9116-565753954618 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "DELETE /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments/5444b6dd-cb0d-4894-942d-bbcf7ffb1c34" status: 202 len: 0 microversion: 2.1 time: 0.209030 Jan 24 22:34:19.556908 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 493/968] 10.222.0.84 () {58 vars in 1415 bytes} [Mon Jan 24 22:34:19 2022] DELETE /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments/5444b6dd-cb0d-4894-942d-bbcf7ffb1c34 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:34:19.653955 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-9b301dfa-05c9-4ae1-b369-42027d93b807 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.364305 Jan 24 22:34:19.656744 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 476/969] 10.222.0.84 () {62 vars in 1363 bytes} [Mon Jan 24 22:34:19 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/os-volume_attachments => generated 188 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 22:34:19.784838 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2b653d37-f7fb-4721-bb8a-843bfb11880d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:19.786426 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2b653d37-f7fb-4721-bb8a-843bfb11880d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:19.793361 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2b653d37-f7fb-4721-bb8a-843bfb11880d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:19.793808 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2b653d37-f7fb-4721-bb8a-843bfb11880d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:19.794673 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2b653d37-f7fb-4721-bb8a-843bfb11880d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:19.795127 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2b653d37-f7fb-4721-bb8a-843bfb11880d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:20.081939 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2b653d37-f7fb-4721-bb8a-843bfb11880d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "DELETE /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/os-volume_attachments/870ba125-0219-4fae-885a-931626605019" status: 202 len: 0 microversion: 2.20 time: 0.301400 Jan 24 22:34:20.082543 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 494/970] 10.222.0.84 () {60 vars in 1456 bytes} [Mon Jan 24 22:34:19 2022] DELETE /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/os-volume_attachments/870ba125-0219-4fae-885a-931626605019 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:34:20.140210 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c970c47c-b571-4eee-81de-37b8054128ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:34:20.140775 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c970c47c-b571-4eee-81de-37b8054128ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:20.147176 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c970c47c-b571-4eee-81de-37b8054128ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:20.147969 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c970c47c-b571-4eee-81de-37b8054128ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:20.148402 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c970c47c-b571-4eee-81de-37b8054128ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:20.148833 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c970c47c-b571-4eee-81de-37b8054128ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:20.298729 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c970c47c-b571-4eee-81de-37b8054128ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action" status: 202 len: 0 microversion: 2.20 time: 0.162112 Jan 24 22:34:20.299254 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 477/971] 10.222.0.84 () {62 vars in 1318 bytes} [Mon Jan 24 22:34:20 2022] POST /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:34:20.307720 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b557d6d5-ec3f-4961-8edc-d7e6f47c004d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:20.308432 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b557d6d5-ec3f-4961-8edc-d7e6f47c004d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:20.315517 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b557d6d5-ec3f-4961-8edc-d7e6f47c004d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:20.315961 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b557d6d5-ec3f-4961-8edc-d7e6f47c004d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:20.316735 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b557d6d5-ec3f-4961-8edc-d7e6f47c004d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:20.317211 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b557d6d5-ec3f-4961-8edc-d7e6f47c004d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:20.486136 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b557d6d5-ec3f-4961-8edc-d7e6f47c004d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:20.494857 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b557d6d5-ec3f-4961-8edc-d7e6f47c004d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:20.496376 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b557d6d5-ec3f-4961-8edc-d7e6f47c004d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:20.497771 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b557d6d5-ec3f-4961-8edc-d7e6f47c004d tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1674 microversion: 2.20 time: 0.194078 Jan 24 22:34:20.498545 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 495/972] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:20 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1674 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:34:21.516258 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6c089e2a-46c4-46c7-84be-6355d3110c49 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:21.516867 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6c089e2a-46c4-46c7-84be-6355d3110c49 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:21.524587 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6c089e2a-46c4-46c7-84be-6355d3110c49 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:21.525098 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6c089e2a-46c4-46c7-84be-6355d3110c49 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:21.525922 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6c089e2a-46c4-46c7-84be-6355d3110c49 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:21.526445 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6c089e2a-46c4-46c7-84be-6355d3110c49 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:21.659935 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-6c089e2a-46c4-46c7-84be-6355d3110c49 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:21.668329 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-6c089e2a-46c4-46c7-84be-6355d3110c49 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:21.669856 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-6c089e2a-46c4-46c7-84be-6355d3110c49 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:21.671018 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6c089e2a-46c4-46c7-84be-6355d3110c49 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1732 microversion: 2.20 time: 0.159105 Jan 24 22:34:21.671582 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 478/973] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:21 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:21.733301 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-dfd7480f-f49b-415c-925e-56d9e418c718 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:21.733858 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-dfd7480f-f49b-415c-925e-56d9e418c718 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:21.740819 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dfd7480f-f49b-415c-925e-56d9e418c718 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:21.741277 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dfd7480f-f49b-415c-925e-56d9e418c718 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:21.742493 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dfd7480f-f49b-415c-925e-56d9e418c718 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:21.742926 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dfd7480f-f49b-415c-925e-56d9e418c718 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:21.781922 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-dfd7480f-f49b-415c-925e-56d9e418c718 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments/1d675baa-35ed-4d30-a493-3265d2dd468e" status: 200 len: 194 microversion: 2.1 time: 0.052312 Jan 24 22:34:21.782945 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 496/974] 10.222.0.84 () {58 vars in 1412 bytes} [Mon Jan 24 22:34:21 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments/1d675baa-35ed-4d30-a493-3265d2dd468e => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:21.793099 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7fac189b-d545-4fcf-a166-12b5b0e70ac8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:21.793703 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7fac189b-d545-4fcf-a166-12b5b0e70ac8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:21.800465 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7fac189b-d545-4fcf-a166-12b5b0e70ac8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:21.801031 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7fac189b-d545-4fcf-a166-12b5b0e70ac8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:21.801909 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7fac189b-d545-4fcf-a166-12b5b0e70ac8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:21.802415 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7fac189b-d545-4fcf-a166-12b5b0e70ac8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:21.884903 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.objects.instance [None req-7fac189b-d545-4fcf-a166-12b5b0e70ac8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lazy-loading 'services' on Instance uuid 4d98aba3-4e1a-4acd-9aff-582acd7e2322 {{(pid=116466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:34:21.959374 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7fac189b-d545-4fcf-a166-12b5b0e70ac8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "DELETE /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments/1d675baa-35ed-4d30-a493-3265d2dd468e" status: 202 len: 0 microversion: 2.1 time: 0.170473 Jan 24 22:34:21.959960 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 479/975] 10.222.0.84 () {58 vars in 1415 bytes} [Mon Jan 24 22:34:21 2022] DELETE /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments/1d675baa-35ed-4d30-a493-3265d2dd468e => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:34:22.690048 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6de6e810-0042-467f-a912-5533facb5334 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:22.690655 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6de6e810-0042-467f-a912-5533facb5334 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:22.697761 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6de6e810-0042-467f-a912-5533facb5334 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:22.698188 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6de6e810-0042-467f-a912-5533facb5334 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:22.698976 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6de6e810-0042-467f-a912-5533facb5334 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:22.699405 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6de6e810-0042-467f-a912-5533facb5334 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:22.881598 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6de6e810-0042-467f-a912-5533facb5334 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:22.893076 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6de6e810-0042-467f-a912-5533facb5334 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:22.895226 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6de6e810-0042-467f-a912-5533facb5334 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:22.896971 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6de6e810-0042-467f-a912-5533facb5334 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1732 microversion: 2.20 time: 0.210731 Jan 24 22:34:22.908863 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 497/976] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:22 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1732 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:23.173263 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-70d4934e-2210-4d81-a4cd-5fa983449e2a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:23.174930 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-70d4934e-2210-4d81-a4cd-5fa983449e2a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:23.182115 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-70d4934e-2210-4d81-a4cd-5fa983449e2a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:23.182858 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-70d4934e-2210-4d81-a4cd-5fa983449e2a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:23.183928 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-70d4934e-2210-4d81-a4cd-5fa983449e2a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:23.184391 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-70d4934e-2210-4d81-a4cd-5fa983449e2a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:23.221438 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-70d4934e-2210-4d81-a4cd-5fa983449e2a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052837 Jan 24 22:34:23.225959 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 480/977] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:34:23 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:23.917561 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9c328497-5bee-4341-9c0e-c131eb8d7553 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:23.919457 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9c328497-5bee-4341-9c0e-c131eb8d7553 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:23.928225 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9c328497-5bee-4341-9c0e-c131eb8d7553 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:23.929224 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9c328497-5bee-4341-9c0e-c131eb8d7553 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:23.930978 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9c328497-5bee-4341-9c0e-c131eb8d7553 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:23.931800 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9c328497-5bee-4341-9c0e-c131eb8d7553 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:24.064848 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-9c328497-5bee-4341-9c0e-c131eb8d7553 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:24.073549 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-9c328497-5bee-4341-9c0e-c131eb8d7553 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:24.075034 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-9c328497-5bee-4341-9c0e-c131eb8d7553 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:24.076252 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9c328497-5bee-4341-9c0e-c131eb8d7553 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1732 microversion: 2.20 time: 0.164256 Jan 24 22:34:24.076818 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 498/978] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:23 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:24.236308 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-d6194901-c9f1-4abc-9326-d62608bec092 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:24.237453 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d6194901-c9f1-4abc-9326-d62608bec092 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:24.244005 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d6194901-c9f1-4abc-9326-d62608bec092 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:24.244457 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d6194901-c9f1-4abc-9326-d62608bec092 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:24.245293 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d6194901-c9f1-4abc-9326-d62608bec092 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:24.245722 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d6194901-c9f1-4abc-9326-d62608bec092 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:24.279460 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-d6194901-c9f1-4abc-9326-d62608bec092 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047004 Jan 24 22:34:24.281169 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 481/979] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:34:24 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:25.097989 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ddfe8416-9faa-41e1-843a-6d7f65fe99ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:25.098936 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ddfe8416-9faa-41e1-843a-6d7f65fe99ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:25.107121 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ddfe8416-9faa-41e1-843a-6d7f65fe99ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:25.107570 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ddfe8416-9faa-41e1-843a-6d7f65fe99ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:25.108331 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ddfe8416-9faa-41e1-843a-6d7f65fe99ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:25.108757 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ddfe8416-9faa-41e1-843a-6d7f65fe99ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:25.250316 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ddfe8416-9faa-41e1-843a-6d7f65fe99ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:25.258816 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ddfe8416-9faa-41e1-843a-6d7f65fe99ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:25.260290 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ddfe8416-9faa-41e1-843a-6d7f65fe99ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:25.261470 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ddfe8416-9faa-41e1-843a-6d7f65fe99ed tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1732 microversion: 2.20 time: 0.169767 Jan 24 22:34:25.262061 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 499/980] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:25 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:25.291205 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a6c25812-713a-4ddf-bc5f-2f7565fa78ed tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:25.292104 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a6c25812-713a-4ddf-bc5f-2f7565fa78ed tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:25.298492 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a6c25812-713a-4ddf-bc5f-2f7565fa78ed tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:25.298928 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a6c25812-713a-4ddf-bc5f-2f7565fa78ed tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:25.299686 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a6c25812-713a-4ddf-bc5f-2f7565fa78ed tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:25.300104 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a6c25812-713a-4ddf-bc5f-2f7565fa78ed tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:25.329779 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a6c25812-713a-4ddf-bc5f-2f7565fa78ed tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042314 Jan 24 22:34:25.330323 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 482/981] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:34:25 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:26.284047 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4aa868d7-869b-42a9-ad00-11764f0b071c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:26.285261 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4aa868d7-869b-42a9-ad00-11764f0b071c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:26.296314 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4aa868d7-869b-42a9-ad00-11764f0b071c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:26.297200 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4aa868d7-869b-42a9-ad00-11764f0b071c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:26.298337 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4aa868d7-869b-42a9-ad00-11764f0b071c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:26.299044 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4aa868d7-869b-42a9-ad00-11764f0b071c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:26.342176 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7aa5f50f-4c0f-46f7-9d20-ab3918a3bf84 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:26.343884 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7aa5f50f-4c0f-46f7-9d20-ab3918a3bf84 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:26.353948 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7aa5f50f-4c0f-46f7-9d20-ab3918a3bf84 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:26.354824 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7aa5f50f-4c0f-46f7-9d20-ab3918a3bf84 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:26.356206 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7aa5f50f-4c0f-46f7-9d20-ab3918a3bf84 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:26.356854 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7aa5f50f-4c0f-46f7-9d20-ab3918a3bf84 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:26.390098 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7aa5f50f-4c0f-46f7-9d20-ab3918a3bf84 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052055 Jan 24 22:34:26.391352 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 483/982] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:34:26 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:26.464215 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4aa868d7-869b-42a9-ad00-11764f0b071c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:26.472815 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4aa868d7-869b-42a9-ad00-11764f0b071c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:26.474345 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4aa868d7-869b-42a9-ad00-11764f0b071c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:26.475502 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4aa868d7-869b-42a9-ad00-11764f0b071c tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1732 microversion: 2.20 time: 0.197699 Jan 24 22:34:26.476073 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 500/983] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:26 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1732 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:27.402701 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-88a41eae-403c-41d7-99cd-adfb3b10eb6a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:27.403700 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-88a41eae-403c-41d7-99cd-adfb3b10eb6a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:27.411484 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-88a41eae-403c-41d7-99cd-adfb3b10eb6a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:27.412348 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-88a41eae-403c-41d7-99cd-adfb3b10eb6a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:27.413537 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-88a41eae-403c-41d7-99cd-adfb3b10eb6a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:27.414141 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-88a41eae-403c-41d7-99cd-adfb3b10eb6a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:27.450238 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-88a41eae-403c-41d7-99cd-adfb3b10eb6a tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052082 Jan 24 22:34:27.451021 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 484/984] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:34:27 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:27.494105 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-24b54cd0-3c7c-447b-934b-693028d3b0c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:27.494717 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-24b54cd0-3c7c-447b-934b-693028d3b0c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:27.501875 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-24b54cd0-3c7c-447b-934b-693028d3b0c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:27.502324 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-24b54cd0-3c7c-447b-934b-693028d3b0c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:27.503118 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-24b54cd0-3c7c-447b-934b-693028d3b0c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:27.503554 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-24b54cd0-3c7c-447b-934b-693028d3b0c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:27.648900 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-24b54cd0-3c7c-447b-934b-693028d3b0c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:27.660094 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-24b54cd0-3c7c-447b-934b-693028d3b0c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:27.671117 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-24b54cd0-3c7c-447b-934b-693028d3b0c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:27.672451 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-24b54cd0-3c7c-447b-934b-693028d3b0c2 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1732 microversion: 2.20 time: 0.182266 Jan 24 22:34:27.673538 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 501/985] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:27 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:28.462821 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-851b929c-e968-4d3c-8334-612716dd4d2b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:28.464691 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-851b929c-e968-4d3c-8334-612716dd4d2b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:28.471304 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-851b929c-e968-4d3c-8334-612716dd4d2b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:28.471749 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-851b929c-e968-4d3c-8334-612716dd4d2b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:28.472540 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-851b929c-e968-4d3c-8334-612716dd4d2b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:28.472967 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-851b929c-e968-4d3c-8334-612716dd4d2b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:28.503598 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-851b929c-e968-4d3c-8334-612716dd4d2b tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045160 Jan 24 22:34:28.504106 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 485/986] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:34:28 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:28.695628 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-84d526fa-5450-4636-a271-12837b42b14f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:28.696573 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-84d526fa-5450-4636-a271-12837b42b14f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:28.707461 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-84d526fa-5450-4636-a271-12837b42b14f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:28.708207 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-84d526fa-5450-4636-a271-12837b42b14f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:28.709618 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-84d526fa-5450-4636-a271-12837b42b14f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:28.710296 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-84d526fa-5450-4636-a271-12837b42b14f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:28.865951 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-84d526fa-5450-4636-a271-12837b42b14f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:28.875471 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-84d526fa-5450-4636-a271-12837b42b14f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:28.877439 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-84d526fa-5450-4636-a271-12837b42b14f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:28.878703 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-84d526fa-5450-4636-a271-12837b42b14f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1732 microversion: 2.20 time: 0.189363 Jan 24 22:34:28.880336 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 502/987] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:28 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:29.516654 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7ce42617-b0b4-4a8d-b287-39365b89e8ab tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:29.517562 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7ce42617-b0b4-4a8d-b287-39365b89e8ab tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:29.523827 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7ce42617-b0b4-4a8d-b287-39365b89e8ab tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:29.524297 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7ce42617-b0b4-4a8d-b287-39365b89e8ab tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:29.525098 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7ce42617-b0b4-4a8d-b287-39365b89e8ab tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:29.525527 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7ce42617-b0b4-4a8d-b287-39365b89e8ab tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:29.555641 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7ce42617-b0b4-4a8d-b287-39365b89e8ab tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043696 Jan 24 22:34:29.556191 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 486/988] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:34:29 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:29.899768 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2217b8dd-2084-40e8-a50d-672490327d13 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:29.901538 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2217b8dd-2084-40e8-a50d-672490327d13 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:29.909980 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2217b8dd-2084-40e8-a50d-672490327d13 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:29.911062 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2217b8dd-2084-40e8-a50d-672490327d13 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:29.912104 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2217b8dd-2084-40e8-a50d-672490327d13 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:29.912848 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2217b8dd-2084-40e8-a50d-672490327d13 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:30.050140 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2217b8dd-2084-40e8-a50d-672490327d13 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:30.058112 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2217b8dd-2084-40e8-a50d-672490327d13 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:30.060018 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2217b8dd-2084-40e8-a50d-672490327d13 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:30.061210 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2217b8dd-2084-40e8-a50d-672490327d13 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1732 microversion: 2.20 time: 0.166738 Jan 24 22:34:30.061748 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 503/989] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:29 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:30.567526 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-333ef03d-94fb-4a12-a871-db54e3cedf10 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:30.568436 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-333ef03d-94fb-4a12-a871-db54e3cedf10 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:30.575030 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-333ef03d-94fb-4a12-a871-db54e3cedf10 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:30.575481 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-333ef03d-94fb-4a12-a871-db54e3cedf10 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:30.576442 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-333ef03d-94fb-4a12-a871-db54e3cedf10 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:30.576869 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-333ef03d-94fb-4a12-a871-db54e3cedf10 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:30.608100 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-333ef03d-94fb-4a12-a871-db54e3cedf10 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044235 Jan 24 22:34:30.608572 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 487/990] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:34:30 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:31.087743 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9d0641a1-66a6-4de1-a740-a94182692669 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:31.088457 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9d0641a1-66a6-4de1-a740-a94182692669 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:31.095821 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9d0641a1-66a6-4de1-a740-a94182692669 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:31.096438 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9d0641a1-66a6-4de1-a740-a94182692669 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:31.097244 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9d0641a1-66a6-4de1-a740-a94182692669 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:31.097670 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9d0641a1-66a6-4de1-a740-a94182692669 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:31.241498 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-9d0641a1-66a6-4de1-a740-a94182692669 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:31.249935 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-9d0641a1-66a6-4de1-a740-a94182692669 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:31.251497 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-9d0641a1-66a6-4de1-a740-a94182692669 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:31.252679 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9d0641a1-66a6-4de1-a740-a94182692669 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1732 microversion: 2.20 time: 0.169258 Jan 24 22:34:31.253264 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 504/991] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:31 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:31.620015 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-375e1100-d72b-404d-ae96-60b2211ebbc8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:31.620830 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-375e1100-d72b-404d-ae96-60b2211ebbc8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:31.627536 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-375e1100-d72b-404d-ae96-60b2211ebbc8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:31.627980 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-375e1100-d72b-404d-ae96-60b2211ebbc8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:31.628738 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-375e1100-d72b-404d-ae96-60b2211ebbc8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:31.629193 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-375e1100-d72b-404d-ae96-60b2211ebbc8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:31.666908 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-375e1100-d72b-404d-ae96-60b2211ebbc8 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050591 Jan 24 22:34:31.671901 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 488/992] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:34:31 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:32.275188 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-520d83ce-235e-4e3d-9198-bbf8d79e622a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:32.276137 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-520d83ce-235e-4e3d-9198-bbf8d79e622a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:32.286650 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-520d83ce-235e-4e3d-9198-bbf8d79e622a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:32.287387 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-520d83ce-235e-4e3d-9198-bbf8d79e622a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:32.288649 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-520d83ce-235e-4e3d-9198-bbf8d79e622a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:32.289405 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-520d83ce-235e-4e3d-9198-bbf8d79e622a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:32.424970 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-520d83ce-235e-4e3d-9198-bbf8d79e622a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:32.438072 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-520d83ce-235e-4e3d-9198-bbf8d79e622a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:32.440190 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-520d83ce-235e-4e3d-9198-bbf8d79e622a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:32.442055 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-520d83ce-235e-4e3d-9198-bbf8d79e622a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1732 microversion: 2.20 time: 0.172899 Jan 24 22:34:32.442852 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 505/993] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:32 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:32.683156 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-be8379cc-940b-4338-a54a-7303e1f9707d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:32.684601 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-be8379cc-940b-4338-a54a-7303e1f9707d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:32.692003 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-be8379cc-940b-4338-a54a-7303e1f9707d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:32.692447 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-be8379cc-940b-4338-a54a-7303e1f9707d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:32.693263 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-be8379cc-940b-4338-a54a-7303e1f9707d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:32.693696 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-be8379cc-940b-4338-a54a-7303e1f9707d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:32.723412 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-be8379cc-940b-4338-a54a-7303e1f9707d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046629 Jan 24 22:34:32.723951 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 489/994] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:34:32 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:33.467453 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-356a0af0-9a1b-47d5-aa7d-f0f2a31ca371 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:33.468279 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-356a0af0-9a1b-47d5-aa7d-f0f2a31ca371 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:33.475091 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-356a0af0-9a1b-47d5-aa7d-f0f2a31ca371 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:33.475540 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-356a0af0-9a1b-47d5-aa7d-f0f2a31ca371 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:33.476323 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-356a0af0-9a1b-47d5-aa7d-f0f2a31ca371 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:33.476758 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-356a0af0-9a1b-47d5-aa7d-f0f2a31ca371 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:33.623783 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-356a0af0-9a1b-47d5-aa7d-f0f2a31ca371 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:33.632800 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-356a0af0-9a1b-47d5-aa7d-f0f2a31ca371 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:33.634324 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-356a0af0-9a1b-47d5-aa7d-f0f2a31ca371 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:33.635481 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-356a0af0-9a1b-47d5-aa7d-f0f2a31ca371 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1732 microversion: 2.20 time: 0.174102 Jan 24 22:34:33.636055 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 506/995] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:33 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:33.737337 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-5e538aeb-c374-4ce2-9720-ba2ef9dda7d3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:33.738334 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-5e538aeb-c374-4ce2-9720-ba2ef9dda7d3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:33.745851 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5e538aeb-c374-4ce2-9720-ba2ef9dda7d3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:33.746353 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5e538aeb-c374-4ce2-9720-ba2ef9dda7d3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:33.747209 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5e538aeb-c374-4ce2-9720-ba2ef9dda7d3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:33.747710 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5e538aeb-c374-4ce2-9720-ba2ef9dda7d3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:33.779440 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-5e538aeb-c374-4ce2-9720-ba2ef9dda7d3 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046774 Jan 24 22:34:33.780006 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 490/996] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:34:33 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 22:34:33.887235 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-30480e8d-8399-4fce-8591-18553aed0a61 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:33.888671 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-30480e8d-8399-4fce-8591-18553aed0a61 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:33.895564 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-30480e8d-8399-4fce-8591-18553aed0a61 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:33.896011 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-30480e8d-8399-4fce-8591-18553aed0a61 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:33.896780 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-30480e8d-8399-4fce-8591-18553aed0a61 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:33.897243 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-30480e8d-8399-4fce-8591-18553aed0a61 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:33.925117 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-30480e8d-8399-4fce-8591-18553aed0a61 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043810 Jan 24 22:34:33.925657 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 507/997] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:34:33 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 22:34:33.991115 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ca6309ab-06b4-4137-9e4a-b2d437344363 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:33.991643 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ca6309ab-06b4-4137-9e4a-b2d437344363 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:33.997784 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ca6309ab-06b4-4137-9e4a-b2d437344363 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:33.998236 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ca6309ab-06b4-4137-9e4a-b2d437344363 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:33.999353 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ca6309ab-06b4-4137-9e4a-b2d437344363 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:33.999780 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ca6309ab-06b4-4137-9e4a-b2d437344363 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:34.025126 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ca6309ab-06b4-4137-9e4a-b2d437344363 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Going to try to terminate instance {{(pid=116466) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:34:34.105896 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ca6309ab-06b4-4137-9e4a-b2d437344363 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "DELETE /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 204 len: 0 microversion: 2.1 time: 0.119055 Jan 24 22:34:34.106407 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 491/998] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:34:33 2022] DELETE /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:34:34.115278 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ec1ce9ca-7715-4745-a7d1-c98f1136030e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:34.115868 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ec1ce9ca-7715-4745-a7d1-c98f1136030e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:34.121875 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ec1ce9ca-7715-4745-a7d1-c98f1136030e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:34.122331 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ec1ce9ca-7715-4745-a7d1-c98f1136030e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:34.123112 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ec1ce9ca-7715-4745-a7d1-c98f1136030e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:34.123632 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ec1ce9ca-7715-4745-a7d1-c98f1136030e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:34.263063 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ec1ce9ca-7715-4745-a7d1-c98f1136030e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:34.274342 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ec1ce9ca-7715-4745-a7d1-c98f1136030e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1675 microversion: 2.1 time: 0.162857 Jan 24 22:34:34.275140 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 508/999] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:34 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:34:34.659019 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8f2c2bfa-93a6-41b7-9c41-0169907498fd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:34.660155 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8f2c2bfa-93a6-41b7-9c41-0169907498fd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:34.671125 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8f2c2bfa-93a6-41b7-9c41-0169907498fd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:34.671582 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8f2c2bfa-93a6-41b7-9c41-0169907498fd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:34.672358 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8f2c2bfa-93a6-41b7-9c41-0169907498fd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:34.672789 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8f2c2bfa-93a6-41b7-9c41-0169907498fd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:34.818309 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-8f2c2bfa-93a6-41b7-9c41-0169907498fd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:34.828054 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-8f2c2bfa-93a6-41b7-9c41-0169907498fd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:34.829594 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-8f2c2bfa-93a6-41b7-9c41-0169907498fd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:34.830739 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8f2c2bfa-93a6-41b7-9c41-0169907498fd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1732 microversion: 2.20 time: 0.178835 Jan 24 22:34:34.831297 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 492/1000] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:34 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:35.297626 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3b879476-bac0-4835-b26e-e039119caee2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:35.298467 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-3b879476-bac0-4835-b26e-e039119caee2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:35.307205 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3b879476-bac0-4835-b26e-e039119caee2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:35.307798 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3b879476-bac0-4835-b26e-e039119caee2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:35.308815 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3b879476-bac0-4835-b26e-e039119caee2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:35.309429 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3b879476-bac0-4835-b26e-e039119caee2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:35.455913 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3b879476-bac0-4835-b26e-e039119caee2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:35.463517 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-3b879476-bac0-4835-b26e-e039119caee2 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1675 microversion: 2.1 time: 0.171892 Jan 24 22:34:35.473410 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 509/1001] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:35 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:34:35.858256 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-84340d5e-687a-4b8c-95f2-28c1a1e750e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:35.859058 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-84340d5e-687a-4b8c-95f2-28c1a1e750e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:35.866977 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-84340d5e-687a-4b8c-95f2-28c1a1e750e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:35.867426 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-84340d5e-687a-4b8c-95f2-28c1a1e750e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:35.868216 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-84340d5e-687a-4b8c-95f2-28c1a1e750e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:35.868860 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-84340d5e-687a-4b8c-95f2-28c1a1e750e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:36.009017 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-84340d5e-687a-4b8c-95f2-28c1a1e750e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:36.017731 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-84340d5e-687a-4b8c-95f2-28c1a1e750e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:36.019220 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-84340d5e-687a-4b8c-95f2-28c1a1e750e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:36.020354 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-84340d5e-687a-4b8c-95f2-28c1a1e750e5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1732 microversion: 2.20 time: 0.169271 Jan 24 22:34:36.029047 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 493/1002] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:35 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:36.481294 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e465ad23-d712-4db9-936f-f5d897a71cc6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:36.481847 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e465ad23-d712-4db9-936f-f5d897a71cc6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:36.488535 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e465ad23-d712-4db9-936f-f5d897a71cc6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:36.488975 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e465ad23-d712-4db9-936f-f5d897a71cc6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:36.489769 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e465ad23-d712-4db9-936f-f5d897a71cc6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:36.490188 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e465ad23-d712-4db9-936f-f5d897a71cc6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:36.625813 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e465ad23-d712-4db9-936f-f5d897a71cc6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:36.633746 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e465ad23-d712-4db9-936f-f5d897a71cc6 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1675 microversion: 2.1 time: 0.156309 Jan 24 22:34:36.634317 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 510/1003] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:36 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:34:37.039704 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-fd880b59-b7ee-45a5-b192-f2e10ed1b77a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:37.040393 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-fd880b59-b7ee-45a5-b192-f2e10ed1b77a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:37.047235 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fd880b59-b7ee-45a5-b192-f2e10ed1b77a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:37.047631 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fd880b59-b7ee-45a5-b192-f2e10ed1b77a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:37.048419 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fd880b59-b7ee-45a5-b192-f2e10ed1b77a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:37.048854 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-fd880b59-b7ee-45a5-b192-f2e10ed1b77a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:37.131448 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-0206372f-d768-46b2-b7be-53be28ef9f42 req-5061ce70-f656-48b3-9592-fbec9f35cc3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d98aba3-4e1a-4acd-9aff-582acd7e2322", "name": "network-vif-deleted", "tag": "2224cb8d-9ba5-46c9-9ad0-f349156ad1fb"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:34:37.133001 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:34:37.133001 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:34:37.147358 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-0206372f-d768-46b2-b7be-53be28ef9f42 req-5061ce70-f656-48b3-9592-fbec9f35cc3c service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:37.147841 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-0206372f-d768-46b2-b7be-53be28ef9f42 req-5061ce70-f656-48b3-9592-fbec9f35cc3c service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:37.160783 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-0206372f-d768-46b2-b7be-53be28ef9f42 req-5061ce70-f656-48b3-9592-fbec9f35cc3c service nova] Creating event network-vif-deleted:2224cb8d-9ba5-46c9-9ad0-f349156ad1fb for instance 4d98aba3-4e1a-4acd-9aff-582acd7e2322 on hv-cinder-81322 Jan 24 22:34:37.166455 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-0206372f-d768-46b2-b7be-53be28ef9f42 req-5061ce70-f656-48b3-9592-fbec9f35cc3c service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038936 Jan 24 22:34:37.170057 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 511/1004] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:37.196795 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-fd880b59-b7ee-45a5-b192-f2e10ed1b77a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:37.207558 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-fd880b59-b7ee-45a5-b192-f2e10ed1b77a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:37.209077 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-fd880b59-b7ee-45a5-b192-f2e10ed1b77a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:37.210278 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-fd880b59-b7ee-45a5-b192-f2e10ed1b77a tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1732 microversion: 2.20 time: 0.174436 Jan 24 22:34:37.210838 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 494/1005] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:37 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:37.652838 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-18dd772a-33d1-4150-a4ef-9f4bef2a0141 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:37.653564 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-18dd772a-33d1-4150-a4ef-9f4bef2a0141 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:37.661386 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-18dd772a-33d1-4150-a4ef-9f4bef2a0141 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:37.661826 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-18dd772a-33d1-4150-a4ef-9f4bef2a0141 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:37.662684 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-18dd772a-33d1-4150-a4ef-9f4bef2a0141 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:37.663111 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-18dd772a-33d1-4150-a4ef-9f4bef2a0141 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:37.699090 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-18dd772a-33d1-4150-a4ef-9f4bef2a0141 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:37.699332 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-18dd772a-33d1-4150-a4ef-9f4bef2a0141 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:37.699590 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-18dd772a-33d1-4150-a4ef-9f4bef2a0141 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lazy-loading 'fault' on Instance uuid 4d98aba3-4e1a-4acd-9aff-582acd7e2322 {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:34:37.741198 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-18dd772a-33d1-4150-a4ef-9f4bef2a0141 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96fc7e81114482c8149bb10fa4d6cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971e5fb7e6884a74947db35700479fea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:37.749541 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-18dd772a-33d1-4150-a4ef-9f4bef2a0141 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 200 len: 1327 microversion: 2.1 time: 0.101327 Jan 24 22:34:37.750128 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 512/1006] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:37 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:34:38.002400 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-fac8d430-bc88-4d84-bf03-840729886a41 req-eb8311b5-ce57-4915-83f1-d520b7ab394b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6f4177-b89c-480a-a278-c470e82b9241", "name": "network-vif-plugged", "status": "completed", "tag": "b98d14cd-7266-457a-b737-02c742f241f8"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:34:38.003915 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:34:38.003915 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:34:38.011438 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-fac8d430-bc88-4d84-bf03-840729886a41 req-eb8311b5-ce57-4915-83f1-d520b7ab394b service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:38.011902 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-fac8d430-bc88-4d84-bf03-840729886a41 req-eb8311b5-ce57-4915-83f1-d520b7ab394b service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:38.023546 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-fac8d430-bc88-4d84-bf03-840729886a41 req-eb8311b5-ce57-4915-83f1-d520b7ab394b service nova] Creating event network-vif-plugged:b98d14cd-7266-457a-b737-02c742f241f8 for instance ee6f4177-b89c-480a-a278-c470e82b9241 on hv-cinder-81322 Jan 24 22:34:38.028840 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-fac8d430-bc88-4d84-bf03-840729886a41 req-eb8311b5-ce57-4915-83f1-d520b7ab394b service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030190 Jan 24 22:34:38.029464 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 495/1007] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:34:38.229224 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-557fd9d0-ed8d-493e-91af-6f4e0ba28676 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:38.229831 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-557fd9d0-ed8d-493e-91af-6f4e0ba28676 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:38.236189 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-557fd9d0-ed8d-493e-91af-6f4e0ba28676 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:38.236635 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-557fd9d0-ed8d-493e-91af-6f4e0ba28676 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:38.237537 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-557fd9d0-ed8d-493e-91af-6f4e0ba28676 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:38.238317 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-557fd9d0-ed8d-493e-91af-6f4e0ba28676 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:38.390535 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-557fd9d0-ed8d-493e-91af-6f4e0ba28676 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:38.398490 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-557fd9d0-ed8d-493e-91af-6f4e0ba28676 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:38.399971 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-557fd9d0-ed8d-493e-91af-6f4e0ba28676 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:38.401162 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-557fd9d0-ed8d-493e-91af-6f4e0ba28676 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1732 microversion: 2.20 time: 0.175881 Jan 24 22:34:38.401728 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 513/1008] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:38 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:38.773034 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a523574c-92f7-4380-ac2d-f4c09532e642 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:38.774214 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a523574c-92f7-4380-ac2d-f4c09532e642 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:38.783527 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a523574c-92f7-4380-ac2d-f4c09532e642 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:38.783951 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a523574c-92f7-4380-ac2d-f4c09532e642 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:38.784742 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a523574c-92f7-4380-ac2d-f4c09532e642 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:38.785230 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a523574c-92f7-4380-ac2d-f4c09532e642 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:38.799660 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-a523574c-92f7-4380-ac2d-f4c09532e642 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] HTTP exception thrown: Instance 4d98aba3-4e1a-4acd-9aff-582acd7e2322 could not be found. Jan 24 22:34:38.800254 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a523574c-92f7-4380-ac2d-f4c09532e642 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Returning 404 to user: Instance 4d98aba3-4e1a-4acd-9aff-582acd7e2322 could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:34:38.801220 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a523574c-92f7-4380-ac2d-f4c09532e642 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 404 len: 111 microversion: 2.1 time: 0.036418 Jan 24 22:34:38.805141 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 496/1009] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:38 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:34:38.810076 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-d7dca572-5e81-4121-8030-7753b932ce8e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '.version_select at 0x7f7e5d25f4c0>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:38.830412 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-d7dca572-5e81-4121-8030-7753b932ce8e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-230154008" status: 202 len: 0 microversion: 2.1 time: 0.023207 Jan 24 22:34:38.830412 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 514/1010] 10.222.0.84 () {58 vars in 1217 bytes} [Mon Jan 24 22:34:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-230154008 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:34:39.419616 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b343e374-8dc2-4267-b195-36ef83d0598b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:39.420314 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b343e374-8dc2-4267-b195-36ef83d0598b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:39.427113 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b343e374-8dc2-4267-b195-36ef83d0598b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:39.427656 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b343e374-8dc2-4267-b195-36ef83d0598b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:39.428746 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b343e374-8dc2-4267-b195-36ef83d0598b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:39.429351 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b343e374-8dc2-4267-b195-36ef83d0598b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:39.575461 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b343e374-8dc2-4267-b195-36ef83d0598b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:39.584269 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b343e374-8dc2-4267-b195-36ef83d0598b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:39.585766 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b343e374-8dc2-4267-b195-36ef83d0598b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:39.587325 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b343e374-8dc2-4267-b195-36ef83d0598b tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1732 microversion: 2.20 time: 0.171243 Jan 24 22:34:39.589029 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 497/1011] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:39 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:39.882032 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b36151ef-6201-4517-9328-bbb1fe37fe69 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:34:39.882962 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b36151ef-6201-4517-9328-bbb1fe37fe69 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:39.889819 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b36151ef-6201-4517-9328-bbb1fe37fe69 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:39.890207 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b36151ef-6201-4517-9328-bbb1fe37fe69 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:39.890991 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b36151ef-6201-4517-9328-bbb1fe37fe69 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:39.891424 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b36151ef-6201-4517-9328-bbb1fe37fe69 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:39.967183 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b36151ef-6201-4517-9328-bbb1fe37fe69 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "POST /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/action" status: 202 len: 0 microversion: 2.1 time: 0.089566 Jan 24 22:34:39.968104 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 515/1012] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:34:39 2022] POST /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:34:39.976071 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3a7833fc-084d-4ce8-b458-55b8b237d9e9 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:39.977434 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3a7833fc-084d-4ce8-b458-55b8b237d9e9 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:39.983686 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3a7833fc-084d-4ce8-b458-55b8b237d9e9 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:39.984216 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3a7833fc-084d-4ce8-b458-55b8b237d9e9 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:39.985029 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3a7833fc-084d-4ce8-b458-55b8b237d9e9 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:39.985490 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-3a7833fc-084d-4ce8-b458-55b8b237d9e9 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:40.133960 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3a7833fc-084d-4ce8-b458-55b8b237d9e9 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:40.141720 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3a7833fc-084d-4ce8-b458-55b8b237d9e9 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1751 microversion: 2.1 time: 0.169392 Jan 24 22:34:40.142214 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 498/1013] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:39 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:34:40.606174 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-71512b11-ab40-4262-a47f-8ba2d0650009 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:40.606870 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-71512b11-ab40-4262-a47f-8ba2d0650009 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:40.613443 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-71512b11-ab40-4262-a47f-8ba2d0650009 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:40.613866 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-71512b11-ab40-4262-a47f-8ba2d0650009 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:40.614642 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-71512b11-ab40-4262-a47f-8ba2d0650009 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:40.615064 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-71512b11-ab40-4262-a47f-8ba2d0650009 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:40.761447 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-71512b11-ab40-4262-a47f-8ba2d0650009 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:40.769279 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-71512b11-ab40-4262-a47f-8ba2d0650009 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:40.770752 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-71512b11-ab40-4262-a47f-8ba2d0650009 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:40.771880 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-71512b11-ab40-4262-a47f-8ba2d0650009 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1719 microversion: 2.20 time: 0.170438 Jan 24 22:34:40.772437 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 516/1014] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:34:40 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:34:41.164496 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7a6aa855-7ca5-4b00-9bf3-fd76c139472b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:41.165565 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7a6aa855-7ca5-4b00-9bf3-fd76c139472b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:41.176756 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7a6aa855-7ca5-4b00-9bf3-fd76c139472b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:41.177244 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7a6aa855-7ca5-4b00-9bf3-fd76c139472b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:41.178027 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7a6aa855-7ca5-4b00-9bf3-fd76c139472b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:41.178461 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7a6aa855-7ca5-4b00-9bf3-fd76c139472b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:41.328558 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7a6aa855-7ca5-4b00-9bf3-fd76c139472b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:41.336449 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7a6aa855-7ca5-4b00-9bf3-fd76c139472b tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1756 microversion: 2.1 time: 0.178446 Jan 24 22:34:41.337033 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 499/1015] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:41 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:34:41.731712 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-dc652c57-c999-47d9-b200-3c2c273716af tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:41.732230 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-dc652c57-c999-47d9-b200-3c2c273716af tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:41.739172 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dc652c57-c999-47d9-b200-3c2c273716af tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:41.739624 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dc652c57-c999-47d9-b200-3c2c273716af tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:41.740388 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dc652c57-c999-47d9-b200-3c2c273716af tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:41.740814 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dc652c57-c999-47d9-b200-3c2c273716af tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:41.755522 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-dc652c57-c999-47d9-b200-3c2c273716af tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] HTTP exception thrown: Instance 4d98aba3-4e1a-4acd-9aff-582acd7e2322 could not be found. Jan 24 22:34:41.756107 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-dc652c57-c999-47d9-b200-3c2c273716af tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Returning 404 to user: Instance 4d98aba3-4e1a-4acd-9aff-582acd7e2322 could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:34:41.756937 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-dc652c57-c999-47d9-b200-3c2c273716af tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "DELETE /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 404 len: 111 microversion: 2.1 time: 0.028908 Jan 24 22:34:41.757489 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 517/1016] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:34:41 2022] DELETE /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:34:41.765440 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-416a2a4d-4e93-4939-8b16-fef392b7924d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:41.766051 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-416a2a4d-4e93-4939-8b16-fef392b7924d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 4d98aba3-4e1a-4acd-9aff-582acd7e2322] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:41.772527 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-416a2a4d-4e93-4939-8b16-fef392b7924d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:41.772971 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-416a2a4d-4e93-4939-8b16-fef392b7924d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:41.773784 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-416a2a4d-4e93-4939-8b16-fef392b7924d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:41.774217 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-416a2a4d-4e93-4939-8b16-fef392b7924d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:41.788477 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-416a2a4d-4e93-4939-8b16-fef392b7924d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] HTTP exception thrown: Instance 4d98aba3-4e1a-4acd-9aff-582acd7e2322 could not be found. Jan 24 22:34:41.789166 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-416a2a4d-4e93-4939-8b16-fef392b7924d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Returning 404 to user: Instance 4d98aba3-4e1a-4acd-9aff-582acd7e2322 could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:34:41.789975 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-416a2a4d-4e93-4939-8b16-fef392b7924d tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322" status: 404 len: 111 microversion: 2.1 time: 0.028220 Jan 24 22:34:41.790536 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 500/1017] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:41 2022] GET /compute/v2.1/servers/4d98aba3-4e1a-4acd-9aff-582acd7e2322 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:34:42.357892 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4f703845-16f5-41ea-9c43-6d278ab213ac tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:42.358905 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4f703845-16f5-41ea-9c43-6d278ab213ac tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:42.369703 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4f703845-16f5-41ea-9c43-6d278ab213ac tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:42.370452 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4f703845-16f5-41ea-9c43-6d278ab213ac tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:42.371734 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4f703845-16f5-41ea-9c43-6d278ab213ac tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:42.372451 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4f703845-16f5-41ea-9c43-6d278ab213ac tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:42.523801 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4f703845-16f5-41ea-9c43-6d278ab213ac tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:42.534411 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4f703845-16f5-41ea-9c43-6d278ab213ac tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1756 microversion: 2.1 time: 0.182951 Jan 24 22:34:42.534976 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 518/1018] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:42 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:34:42.936082 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e84666f9-2672-4014-bd7b-94fd5c93555e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:42.936768 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e84666f9-2672-4014-bd7b-94fd5c93555e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:42.943750 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e84666f9-2672-4014-bd7b-94fd5c93555e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:42.944209 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e84666f9-2672-4014-bd7b-94fd5c93555e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:42.944997 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e84666f9-2672-4014-bd7b-94fd5c93555e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:42.945530 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e84666f9-2672-4014-bd7b-94fd5c93555e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:42.959076 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-e84666f9-2672-4014-bd7b-94fd5c93555e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] HTTP exception thrown: Instance 3a250b35-2478-48ce-b61d-9eae8933d5fb could not be found. Jan 24 22:34:42.959664 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e84666f9-2672-4014-bd7b-94fd5c93555e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Returning 404 to user: Instance 3a250b35-2478-48ce-b61d-9eae8933d5fb could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:34:42.960516 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e84666f9-2672-4014-bd7b-94fd5c93555e tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "DELETE /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 404 len: 111 microversion: 2.1 time: 0.028502 Jan 24 22:34:42.961069 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 501/1019] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:34:42 2022] DELETE /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:34:42.971458 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1f427421-9149-430c-9c20-60578cc64f85 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:42.972065 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1f427421-9149-430c-9c20-60578cc64f85 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] [instance: 3a250b35-2478-48ce-b61d-9eae8933d5fb] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:42.978999 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1f427421-9149-430c-9c20-60578cc64f85 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:42.979442 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1f427421-9149-430c-9c20-60578cc64f85 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:42.980222 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1f427421-9149-430c-9c20-60578cc64f85 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:42.980647 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1f427421-9149-430c-9c20-60578cc64f85 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:42.995404 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-1f427421-9149-430c-9c20-60578cc64f85 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] HTTP exception thrown: Instance 3a250b35-2478-48ce-b61d-9eae8933d5fb could not be found. Jan 24 22:34:42.995978 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1f427421-9149-430c-9c20-60578cc64f85 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] Returning 404 to user: Instance 3a250b35-2478-48ce-b61d-9eae8933d5fb could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:34:42.996774 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1f427421-9149-430c-9c20-60578cc64f85 tempest-AttachVolumeTestJSON-2002545419 tempest-AttachVolumeTestJSON-2002545419-project] 10.222.0.84 "GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb" status: 404 len: 111 microversion: 2.1 time: 0.029857 Jan 24 22:34:42.997338 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 519/1020] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:42 2022] GET /compute/v2.1/servers/3a250b35-2478-48ce-b61d-9eae8933d5fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:34:43.551592 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-4a0800ac-a370-4848-9e05-ab7182554763 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:43.552102 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-4a0800ac-a370-4848-9e05-ab7182554763 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:43.558102 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4a0800ac-a370-4848-9e05-ab7182554763 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:43.558552 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4a0800ac-a370-4848-9e05-ab7182554763 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:43.559328 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4a0800ac-a370-4848-9e05-ab7182554763 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:43.559760 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4a0800ac-a370-4848-9e05-ab7182554763 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:43.707441 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-4a0800ac-a370-4848-9e05-ab7182554763 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:43.715857 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-4a0800ac-a370-4848-9e05-ab7182554763 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1756 microversion: 2.1 time: 0.168093 Jan 24 22:34:43.716398 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 502/1021] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:43 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:34:44.731640 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-88cd719c-48c4-4d25-9e62-47eee52e80b3 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:44.732310 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-88cd719c-48c4-4d25-9e62-47eee52e80b3 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:44.739450 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-88cd719c-48c4-4d25-9e62-47eee52e80b3 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:44.739902 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-88cd719c-48c4-4d25-9e62-47eee52e80b3 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:44.740685 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-88cd719c-48c4-4d25-9e62-47eee52e80b3 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:44.741158 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-88cd719c-48c4-4d25-9e62-47eee52e80b3 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:44.891202 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-88cd719c-48c4-4d25-9e62-47eee52e80b3 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:44.899141 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-88cd719c-48c4-4d25-9e62-47eee52e80b3 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1756 microversion: 2.1 time: 0.171133 Jan 24 22:34:44.899710 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 520/1022] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:44 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:34:45.916968 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-bf6c1b62-34f8-43b3-a41c-a5d014b5fd2c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:45.917724 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-bf6c1b62-34f8-43b3-a41c-a5d014b5fd2c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:45.925253 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bf6c1b62-34f8-43b3-a41c-a5d014b5fd2c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:45.925575 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bf6c1b62-34f8-43b3-a41c-a5d014b5fd2c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:45.926727 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bf6c1b62-34f8-43b3-a41c-a5d014b5fd2c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:45.927796 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bf6c1b62-34f8-43b3-a41c-a5d014b5fd2c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:46.149164 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-bf6c1b62-34f8-43b3-a41c-a5d014b5fd2c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:46.158417 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-bf6c1b62-34f8-43b3-a41c-a5d014b5fd2c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1756 microversion: 2.1 time: 0.245234 Jan 24 22:34:46.159127 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 503/1023] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:45 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1756 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:34:47.175444 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-7e60625a-88a3-4fef-aea3-7363ed955905 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:47.176061 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-7e60625a-88a3-4fef-aea3-7363ed955905 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:47.182636 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7e60625a-88a3-4fef-aea3-7363ed955905 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:47.183145 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7e60625a-88a3-4fef-aea3-7363ed955905 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:47.184049 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7e60625a-88a3-4fef-aea3-7363ed955905 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:47.184546 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-7e60625a-88a3-4fef-aea3-7363ed955905 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:47.379714 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-7e60625a-88a3-4fef-aea3-7363ed955905 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:47.389276 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-7e60625a-88a3-4fef-aea3-7363ed955905 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1756 microversion: 2.1 time: 0.216746 Jan 24 22:34:47.390794 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 521/1024] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:47 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1756 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:34:48.406819 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-806c2179-7f7f-44f7-b8c0-e94c251210dd tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:48.407429 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-806c2179-7f7f-44f7-b8c0-e94c251210dd tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:48.413848 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-806c2179-7f7f-44f7-b8c0-e94c251210dd tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:48.414315 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-806c2179-7f7f-44f7-b8c0-e94c251210dd tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:48.415085 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-806c2179-7f7f-44f7-b8c0-e94c251210dd tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:48.415514 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-806c2179-7f7f-44f7-b8c0-e94c251210dd tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:48.568946 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-806c2179-7f7f-44f7-b8c0-e94c251210dd tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:48.576668 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-806c2179-7f7f-44f7-b8c0-e94c251210dd tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1756 microversion: 2.1 time: 0.173786 Jan 24 22:34:48.577323 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 504/1025] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:48 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:34:49.594214 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-63ca369f-bec7-499f-966a-3730a9a537cc tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:49.594820 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-63ca369f-bec7-499f-966a-3730a9a537cc tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:49.601373 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-63ca369f-bec7-499f-966a-3730a9a537cc tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:49.601913 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-63ca369f-bec7-499f-966a-3730a9a537cc tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:49.602778 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-63ca369f-bec7-499f-966a-3730a9a537cc tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:49.603216 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-63ca369f-bec7-499f-966a-3730a9a537cc tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:49.758003 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-63ca369f-bec7-499f-966a-3730a9a537cc tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:49.766614 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-63ca369f-bec7-499f-966a-3730a9a537cc tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1756 microversion: 2.1 time: 0.176574 Jan 24 22:34:49.767111 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 522/1026] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:49 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:34:50.784090 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-46c942a4-c9ff-4345-b3bf-75eca6c13d0c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:50.784713 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-46c942a4-c9ff-4345-b3bf-75eca6c13d0c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:50.791349 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-46c942a4-c9ff-4345-b3bf-75eca6c13d0c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:50.791797 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-46c942a4-c9ff-4345-b3bf-75eca6c13d0c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:50.792585 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-46c942a4-c9ff-4345-b3bf-75eca6c13d0c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:50.793035 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-46c942a4-c9ff-4345-b3bf-75eca6c13d0c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:50.945314 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-46c942a4-c9ff-4345-b3bf-75eca6c13d0c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:50.954113 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-46c942a4-c9ff-4345-b3bf-75eca6c13d0c tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1756 microversion: 2.1 time: 0.173782 Jan 24 22:34:50.954688 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 505/1027] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:50 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:34:51.972802 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-422c67f8-8931-4dd0-b6ff-f234f7fc4592 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:34:51.973574 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-422c67f8-8931-4dd0-b6ff-f234f7fc4592 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:34:51.981796 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-422c67f8-8931-4dd0-b6ff-f234f7fc4592 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:51.982347 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-422c67f8-8931-4dd0-b6ff-f234f7fc4592 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:51.983300 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-422c67f8-8931-4dd0-b6ff-f234f7fc4592 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:34:51.983855 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-422c67f8-8931-4dd0-b6ff-f234f7fc4592 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:34:52.139410 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-422c67f8-8931-4dd0-b6ff-f234f7fc4592 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:34:52.147808 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-422c67f8-8931-4dd0-b6ff-f234f7fc4592 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1759 microversion: 2.1 time: 0.179624 Jan 24 22:34:52.148375 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 523/1028] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:34:51 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:35:19.141396 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-38bdbc64-2165-47fd-a4b2-0ff8f5e1e8ce tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:19.142338 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-38bdbc64-2165-47fd-a4b2-0ff8f5e1e8ce tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:19.148441 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-38bdbc64-2165-47fd-a4b2-0ff8f5e1e8ce tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:19.148907 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-38bdbc64-2165-47fd-a4b2-0ff8f5e1e8ce tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:19.149811 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-38bdbc64-2165-47fd-a4b2-0ff8f5e1e8ce tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:19.150335 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-38bdbc64-2165-47fd-a4b2-0ff8f5e1e8ce tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:19.181397 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-38bdbc64-2165-47fd-a4b2-0ff8f5e1e8ce tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043393 Jan 24 22:35:19.182139 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 506/1029] 10.222.0.84 () {60 vars in 1342 bytes} [Mon Jan 24 22:35:19 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:35:19.238955 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-dc40358c-0129-4da1-a261-1de66f5e4140 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:19.239743 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-dc40358c-0129-4da1-a261-1de66f5e4140 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:19.246675 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dc40358c-0129-4da1-a261-1de66f5e4140 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:19.247208 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dc40358c-0129-4da1-a261-1de66f5e4140 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:19.247919 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dc40358c-0129-4da1-a261-1de66f5e4140 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:19.248423 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-dc40358c-0129-4da1-a261-1de66f5e4140 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:19.275353 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-dc40358c-0129-4da1-a261-1de66f5e4140 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Going to try to terminate instance {{(pid=116467) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:35:19.364672 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-dc40358c-0129-4da1-a261-1de66f5e4140 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "DELETE /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 204 len: 0 microversion: 2.20 time: 0.129017 Jan 24 22:35:19.365407 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 524/1030] 10.222.0.84 () {60 vars in 1279 bytes} [Mon Jan 24 22:35:19 2022] DELETE /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 24 22:35:19.373828 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-582c4288-8d71-4cbd-9f87-92b7e2c9c2c5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:19.374424 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-582c4288-8d71-4cbd-9f87-92b7e2c9c2c5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:19.380836 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-582c4288-8d71-4cbd-9f87-92b7e2c9c2c5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:19.381308 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-582c4288-8d71-4cbd-9f87-92b7e2c9c2c5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:19.382079 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-582c4288-8d71-4cbd-9f87-92b7e2c9c2c5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:19.382509 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-582c4288-8d71-4cbd-9f87-92b7e2c9c2c5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:19.528670 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-582c4288-8d71-4cbd-9f87-92b7e2c9c2c5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:19.536830 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-582c4288-8d71-4cbd-9f87-92b7e2c9c2c5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:19.538362 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-582c4288-8d71-4cbd-9f87-92b7e2c9c2c5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:19.539518 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-582c4288-8d71-4cbd-9f87-92b7e2c9c2c5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1725 microversion: 2.20 time: 0.169358 Jan 24 22:35:19.543243 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 507/1031] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:35:19 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 22:35:20.563486 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-64571e88-9571-45da-b876-d6c6c8cd0ef5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:20.564188 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-64571e88-9571-45da-b876-d6c6c8cd0ef5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:20.572122 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-64571e88-9571-45da-b876-d6c6c8cd0ef5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:20.572568 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-64571e88-9571-45da-b876-d6c6c8cd0ef5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:20.574221 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-64571e88-9571-45da-b876-d6c6c8cd0ef5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:20.575596 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-64571e88-9571-45da-b876-d6c6c8cd0ef5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:20.748612 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-64571e88-9571-45da-b876-d6c6c8cd0ef5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:20.761252 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-64571e88-9571-45da-b876-d6c6c8cd0ef5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:20.762253 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-64571e88-9571-45da-b876-d6c6c8cd0ef5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:20.763583 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-64571e88-9571-45da-b876-d6c6c8cd0ef5 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1725 microversion: 2.20 time: 0.205981 Jan 24 22:35:20.764155 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 525/1032] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:35:20 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:35:21.782972 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-91b533d3-49f4-4b6f-b23d-dadda7bac471 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:21.783791 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-91b533d3-49f4-4b6f-b23d-dadda7bac471 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:21.791063 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-91b533d3-49f4-4b6f-b23d-dadda7bac471 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:21.791512 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-91b533d3-49f4-4b6f-b23d-dadda7bac471 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:21.792410 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-91b533d3-49f4-4b6f-b23d-dadda7bac471 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:21.792937 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-91b533d3-49f4-4b6f-b23d-dadda7bac471 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:21.856591 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-91b533d3-49f4-4b6f-b23d-dadda7bac471 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:21.865234 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-91b533d3-49f4-4b6f-b23d-dadda7bac471 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:21.866808 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-91b533d3-49f4-4b6f-b23d-dadda7bac471 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3e0792aba0a4e12bc29eceb648916eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2480860d99554b1c8d0c7845602c854e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:21.868100 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-91b533d3-49f4-4b6f-b23d-dadda7bac471 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 200 len: 1657 microversion: 2.20 time: 0.089840 Jan 24 22:35:21.868739 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 508/1033] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:35:21 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 1657 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 22:35:21.925122 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-6d7ecf73-1f09-445c-9c7b-18fb21a5e308 req-b8576adc-916f-45c0-856a-f8c75b68947b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6f4177-b89c-480a-a278-c470e82b9241", "name": "network-vif-deleted", "tag": "b98d14cd-7266-457a-b737-02c742f241f8"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:35:21.927474 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:35:21.927474 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:35:21.936960 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-6d7ecf73-1f09-445c-9c7b-18fb21a5e308 req-b8576adc-916f-45c0-856a-f8c75b68947b service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:21.937426 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-6d7ecf73-1f09-445c-9c7b-18fb21a5e308 req-b8576adc-916f-45c0-856a-f8c75b68947b service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:21.950313 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-6d7ecf73-1f09-445c-9c7b-18fb21a5e308 req-b8576adc-916f-45c0-856a-f8c75b68947b service nova] Creating event network-vif-deleted:b98d14cd-7266-457a-b737-02c742f241f8 for instance ee6f4177-b89c-480a-a278-c470e82b9241 on hv-cinder-81322 Jan 24 22:35:21.956212 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-6d7ecf73-1f09-445c-9c7b-18fb21a5e308 req-b8576adc-916f-45c0-856a-f8c75b68947b service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034499 Jan 24 22:35:21.957333 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 526/1034] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:22.888757 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8957d24f-0bd2-41bf-ae1b-db9c7f8b14dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:22.890053 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8957d24f-0bd2-41bf-ae1b-db9c7f8b14dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:22.896484 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8957d24f-0bd2-41bf-ae1b-db9c7f8b14dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:22.896927 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8957d24f-0bd2-41bf-ae1b-db9c7f8b14dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:22.897929 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8957d24f-0bd2-41bf-ae1b-db9c7f8b14dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:22.898365 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8957d24f-0bd2-41bf-ae1b-db9c7f8b14dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:22.913952 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-8957d24f-0bd2-41bf-ae1b-db9c7f8b14dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] HTTP exception thrown: Instance ee6f4177-b89c-480a-a278-c470e82b9241 could not be found. Jan 24 22:35:22.914099 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8957d24f-0bd2-41bf-ae1b-db9c7f8b14dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Returning 404 to user: Instance ee6f4177-b89c-480a-a278-c470e82b9241 could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:35:22.914924 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8957d24f-0bd2-41bf-ae1b-db9c7f8b14dd tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 404 len: 111 microversion: 2.20 time: 0.031097 Jan 24 22:35:22.915482 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 509/1035] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:35:22 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 22:35:22.925196 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-53b28322-03fb-49b3-9a85-5ae457b99d2f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '.version_select at 0x7f7e5d1b8040>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:22.944659 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-53b28322-03fb-49b3-9a85-5ae457b99d2f tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768446399" status: 204 len: 0 microversion: 2.20 time: 0.023480 Jan 24 22:35:22.945669 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 527/1036] 10.222.0.84 () {60 vars in 1261 bytes} [Mon Jan 24 22:35:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768446399 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 24 22:35:24.744321 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-89c36590-90e4-45c1-8791-d7cb6bae3f80 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:24.744914 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-89c36590-90e4-45c1-8791-d7cb6bae3f80 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:24.751735 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-89c36590-90e4-45c1-8791-d7cb6bae3f80 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:24.752451 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-89c36590-90e4-45c1-8791-d7cb6bae3f80 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:24.753625 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-89c36590-90e4-45c1-8791-d7cb6bae3f80 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:24.754058 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-89c36590-90e4-45c1-8791-d7cb6bae3f80 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:24.768117 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-89c36590-90e4-45c1-8791-d7cb6bae3f80 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] HTTP exception thrown: Instance ee6f4177-b89c-480a-a278-c470e82b9241 could not be found. Jan 24 22:35:24.768710 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-89c36590-90e4-45c1-8791-d7cb6bae3f80 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Returning 404 to user: Instance ee6f4177-b89c-480a-a278-c470e82b9241 could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:35:24.769567 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-89c36590-90e4-45c1-8791-d7cb6bae3f80 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "DELETE /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 404 len: 111 microversion: 2.20 time: 0.029327 Jan 24 22:35:24.770335 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 510/1037] 10.222.0.84 () {60 vars in 1279 bytes} [Mon Jan 24 22:35:24 2022] DELETE /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 22:35:24.779843 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9411cd6a-cc17-42de-b228-aae15b21e8c4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:24.780653 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9411cd6a-cc17-42de-b228-aae15b21e8c4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: ee6f4177-b89c-480a-a278-c470e82b9241] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:24.787948 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9411cd6a-cc17-42de-b228-aae15b21e8c4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:24.788393 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9411cd6a-cc17-42de-b228-aae15b21e8c4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:24.789309 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9411cd6a-cc17-42de-b228-aae15b21e8c4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:24.789605 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9411cd6a-cc17-42de-b228-aae15b21e8c4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:24.802867 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-9411cd6a-cc17-42de-b228-aae15b21e8c4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] HTTP exception thrown: Instance ee6f4177-b89c-480a-a278-c470e82b9241 could not be found. Jan 24 22:35:24.803556 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9411cd6a-cc17-42de-b228-aae15b21e8c4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Returning 404 to user: Instance ee6f4177-b89c-480a-a278-c470e82b9241 could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:35:24.808247 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9411cd6a-cc17-42de-b228-aae15b21e8c4 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241" status: 404 len: 111 microversion: 2.20 time: 0.030049 Jan 24 22:35:24.808247 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 528/1038] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:35:24 2022] GET /compute/v2.1/servers/ee6f4177-b89c-480a-a278-c470e82b9241 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 24 22:35:25.946130 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-62ba94bf-631c-4956-98f0-e63dc6da9d64 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:25.946628 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-62ba94bf-631c-4956-98f0-e63dc6da9d64 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:25.953692 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-62ba94bf-631c-4956-98f0-e63dc6da9d64 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:25.954140 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-62ba94bf-631c-4956-98f0-e63dc6da9d64 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:25.954948 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-62ba94bf-631c-4956-98f0-e63dc6da9d64 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:25.955389 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-62ba94bf-631c-4956-98f0-e63dc6da9d64 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:25.969023 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-62ba94bf-631c-4956-98f0-e63dc6da9d64 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] HTTP exception thrown: Instance 5995cfc4-026f-45ae-a918-0bc8f1bdc025 could not be found. Jan 24 22:35:25.969627 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-62ba94bf-631c-4956-98f0-e63dc6da9d64 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Returning 404 to user: Instance 5995cfc4-026f-45ae-a918-0bc8f1bdc025 could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:35:25.970477 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-62ba94bf-631c-4956-98f0-e63dc6da9d64 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "DELETE /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 404 len: 111 microversion: 2.20 time: 0.028123 Jan 24 22:35:25.971005 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 511/1039] 10.222.0.84 () {60 vars in 1279 bytes} [Mon Jan 24 22:35:25 2022] DELETE /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 22:35:25.979198 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ff6fc2f4-1809-4a57-889e-786bb950ab21 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:25.979892 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ff6fc2f4-1809-4a57-889e-786bb950ab21 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] [instance: 5995cfc4-026f-45ae-a918-0bc8f1bdc025] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:25.986559 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ff6fc2f4-1809-4a57-889e-786bb950ab21 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:25.987007 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ff6fc2f4-1809-4a57-889e-786bb950ab21 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:25.987782 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ff6fc2f4-1809-4a57-889e-786bb950ab21 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:25.988217 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ff6fc2f4-1809-4a57-889e-786bb950ab21 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:26.002343 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-ff6fc2f4-1809-4a57-889e-786bb950ab21 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] HTTP exception thrown: Instance 5995cfc4-026f-45ae-a918-0bc8f1bdc025 could not be found. Jan 24 22:35:26.003270 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ff6fc2f4-1809-4a57-889e-786bb950ab21 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] Returning 404 to user: Instance 5995cfc4-026f-45ae-a918-0bc8f1bdc025 could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:35:26.004081 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ff6fc2f4-1809-4a57-889e-786bb950ab21 tempest-AttachVolumeShelveTestJSON-1918034575 tempest-AttachVolumeShelveTestJSON-1918034575-project] 10.222.0.84 "GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025" status: 404 len: 111 microversion: 2.20 time: 0.028636 Jan 24 22:35:26.004639 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 529/1040] 10.222.0.84 () {60 vars in 1276 bytes} [Mon Jan 24 22:35:25 2022] GET /compute/v2.1/servers/5995cfc4-026f-45ae-a918-0bc8f1bdc025 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 22:35:30.557606 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-79d4ad9f-d117-48bd-a0ff-e2ae0f983d02 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-420703410"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:35:30.558210 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-79d4ad9f-d117-48bd-a0ff-e2ae0f983d02 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:30.565089 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-79d4ad9f-d117-48bd-a0ff-e2ae0f983d02 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:30.565537 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-79d4ad9f-d117-48bd-a0ff-e2ae0f983d02 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:30.566352 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-79d4ad9f-d117-48bd-a0ff-e2ae0f983d02 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:30.566784 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-79d4ad9f-d117-48bd-a0ff-e2ae0f983d02 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:30.695156 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.network.security_group_api [None req-79d4ad9f-d117-48bd-a0ff-e2ae0f983d02 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Removing security group 25f4cdc4-62bd-43d7-94b9-79cc4611a1c5 from port 5c4e0fd6-fbad-4f01-a8ef-287b2802e9e6 Jan 24 22:35:30.767584 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-08e11b7e-2c59-48a5-bc80-d54caa2564e3 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Action: 'create', calling method: .version_select at 0x7f7e5d16fc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-487928702"}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:35:31.060893 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-08e11b7e-2c59-48a5-bc80-d54caa2564e3 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.404819 Jan 24 22:35:31.061233 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 530/1041] 10.222.0.84 () {60 vars in 1154 bytes} [Mon Jan 24 22:35:30 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 406 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jan 24 22:35:31.073595 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1cf8ab91-0dae-4b1f-85f1-6beedde4f568 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e61e6fa60>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:31.081780 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-79d4ad9f-d117-48bd-a0ff-e2ae0f983d02 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "POST /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/action" status: 202 len: 0 microversion: 2.1 time: 0.525196 Jan 24 22:35:31.086717 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 512/1042] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:35:30 2022] POST /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:35:31.093134 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-b81acdd9-8e93-486b-bb84-3e62b3f8ec47 req-3a090afd-5b68-4475-bf24-acede0e0a4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbc89f6f-34dd-4831-8df6-a7d8b77c4b46", "tag": "5c4e0fd6-fbad-4f01-a8ef-287b2802e9e6"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:35:31.095374 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:35:31.095374 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:35:31.105089 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-b81acdd9-8e93-486b-bb84-3e62b3f8ec47 req-3a090afd-5b68-4475-bf24-acede0e0a4d3 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:31.105876 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-b81acdd9-8e93-486b-bb84-3e62b3f8ec47 req-3a090afd-5b68-4475-bf24-acede0e0a4d3 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:31.119339 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-b81acdd9-8e93-486b-bb84-3e62b3f8ec47 req-3a090afd-5b68-4475-bf24-acede0e0a4d3 service nova] Creating event network-changed:5c4e0fd6-fbad-4f01-a8ef-287b2802e9e6 for instance cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 on hv-cinder-81322 Jan 24 22:35:31.126010 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-b81acdd9-8e93-486b-bb84-3e62b3f8ec47 req-3a090afd-5b68-4475-bf24-acede0e0a4d3 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037991 Jan 24 22:35:31.127200 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 513/1043] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:31.141483 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1cf8ab91-0dae-4b1f-85f1-6beedde4f568 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21" status: 200 len: 344 microversion: 2.1 time: 0.071763 Jan 24 22:35:31.146319 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 531/1044] 10.222.0.84 () {58 vars in 1244 bytes} [Mon Jan 24 22:35:31 2022] GET /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21 => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:35:32.154935 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-652958d9-ee1a-47f6-bcb8-0931a73db0df tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d0bb5e0>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:32.202426 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-652958d9-ee1a-47f6-bcb8-0931a73db0df tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21" status: 200 len: 344 microversion: 2.1 time: 0.052028 Jan 24 22:35:32.202994 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 514/1045] 10.222.0.84 () {58 vars in 1244 bytes} [Mon Jan 24 22:35:32 2022] GET /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:32.470926 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-7602e7b6-86ee-46c9-bbc0-e71809f30928 req-c6a521cb-f6c3-4b25-9208-a80828b7cbba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbc89f6f-34dd-4831-8df6-a7d8b77c4b46", "tag": "5c4e0fd6-fbad-4f01-a8ef-287b2802e9e6"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:35:32.472425 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:35:32.472425 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:35:32.475946 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4f15359e-bb7e-4e19-8a2c-8dd66ce6ee79 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:32.476461 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4f15359e-bb7e-4e19-8a2c-8dd66ce6ee79 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:32.481380 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-7602e7b6-86ee-46c9-bbc0-e71809f30928 req-c6a521cb-f6c3-4b25-9208-a80828b7cbba service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:32.481786 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-7602e7b6-86ee-46c9-bbc0-e71809f30928 req-c6a521cb-f6c3-4b25-9208-a80828b7cbba service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:32.483207 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4f15359e-bb7e-4e19-8a2c-8dd66ce6ee79 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:32.483658 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4f15359e-bb7e-4e19-8a2c-8dd66ce6ee79 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:32.484440 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4f15359e-bb7e-4e19-8a2c-8dd66ce6ee79 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:32.484879 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4f15359e-bb7e-4e19-8a2c-8dd66ce6ee79 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:32.492373 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-7602e7b6-86ee-46c9-bbc0-e71809f30928 req-c6a521cb-f6c3-4b25-9208-a80828b7cbba service nova] Creating event network-changed:5c4e0fd6-fbad-4f01-a8ef-287b2802e9e6 for instance cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 on hv-cinder-81322 Jan 24 22:35:32.497799 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-7602e7b6-86ee-46c9-bbc0-e71809f30928 req-c6a521cb-f6c3-4b25-9208-a80828b7cbba service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030438 Jan 24 22:35:32.498941 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 515/1046] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:32.563900 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-4f15359e-bb7e-4e19-8a2c-8dd66ce6ee79 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lazy-loading 'services' on Instance uuid cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:35:32.634839 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4f15359e-bb7e-4e19-8a2c-8dd66ce6ee79 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "DELETE /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/os-volume_attachments/8d0ee76b-2b62-4547-8545-857a18f50903" status: 202 len: 0 microversion: 2.1 time: 0.170648 Jan 24 22:35:32.635440 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 532/1047] 10.222.0.84 () {58 vars in 1415 bytes} [Mon Jan 24 22:35:32 2022] DELETE /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/os-volume_attachments/8d0ee76b-2b62-4547-8545-857a18f50903 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:35:32.644303 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-632a5db6-4041-4044-9a68-9e1e3d54f3f5 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:32.645322 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-632a5db6-4041-4044-9a68-9e1e3d54f3f5 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:32.651303 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-632a5db6-4041-4044-9a68-9e1e3d54f3f5 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:32.651750 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-632a5db6-4041-4044-9a68-9e1e3d54f3f5 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:32.652599 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-632a5db6-4041-4044-9a68-9e1e3d54f3f5 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:32.653087 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-632a5db6-4041-4044-9a68-9e1e3d54f3f5 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:32.682736 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-632a5db6-4041-4044-9a68-9e1e3d54f3f5 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042426 Jan 24 22:35:32.683291 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 516/1048] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:35:32 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:33.216357 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-7e596674-8724-42f9-91d1-c84d64c00e05 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d28daf0>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:33.265067 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-7e596674-8724-42f9-91d1-c84d64c00e05 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21" status: 200 len: 344 microversion: 2.1 time: 0.053439 Jan 24 22:35:33.266753 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 533/1049] 10.222.0.84 () {58 vars in 1244 bytes} [Mon Jan 24 22:35:33 2022] GET /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:33.694979 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2d8f0fab-37e0-4e1a-9a15-2adf7df3e95f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:33.695997 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2d8f0fab-37e0-4e1a-9a15-2adf7df3e95f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:33.702535 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2d8f0fab-37e0-4e1a-9a15-2adf7df3e95f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:33.703044 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2d8f0fab-37e0-4e1a-9a15-2adf7df3e95f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:33.704028 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2d8f0fab-37e0-4e1a-9a15-2adf7df3e95f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:33.704469 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2d8f0fab-37e0-4e1a-9a15-2adf7df3e95f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:33.735927 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2d8f0fab-37e0-4e1a-9a15-2adf7df3e95f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044824 Jan 24 22:35:33.736691 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 517/1050] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:35:33 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:34.279914 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c677cd39-de43-4ab4-9e3a-7ce7972bc35e tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d18de50>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:34.333366 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c677cd39-de43-4ab4-9e3a-7ce7972bc35e tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21" status: 200 len: 345 microversion: 2.1 time: 0.057569 Jan 24 22:35:34.333478 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 534/1051] 10.222.0.84 () {58 vars in 1244 bytes} [Mon Jan 24 22:35:34 2022] GET /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:34.349151 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-0a4500a1-b749-408a-ad2a-72b6a0438bcf tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Action: 'create', calling method: .version_select at 0x7f7e5d1931f0>, body: {"snapshot": {"volume_id": "71d4b826-056c-40ef-97ab-5389410cac21", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-245790387"}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:35:34.508803 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-0a4500a1-b749-408a-ad2a-72b6a0438bcf tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.163230 Jan 24 22:35:34.509521 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 518/1052] 10.222.0.84 () {60 vars in 1161 bytes} [Mon Jan 24 22:35:34 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:34.519388 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-96877ad5-5296-430d-8d4c-4dc02e26e9f5 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d24cca0>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:34.552027 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-96877ad5-5296-430d-8d4c-4dc02e26e9f5 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/c64c729b-ba76-44ef-8f09-779e2c6bc57c" status: 200 len: 286 microversion: 2.1 time: 0.036308 Jan 24 22:35:34.552700 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 535/1053] 10.222.0.84 () {58 vars in 1250 bytes} [Mon Jan 24 22:35:34 2022] GET /compute/v2.1/os-snapshots/c64c729b-ba76-44ef-8f09-779e2c6bc57c => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:34.562105 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-5485f815-0c3b-4331-91f7-832c8fb8b3a4 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d167dc0>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:34.588696 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-5485f815-0c3b-4331-91f7-832c8fb8b3a4 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.030137 Jan 24 22:35:34.589318 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 519/1054] 10.222.0.84 () {58 vars in 1139 bytes} [Mon Jan 24 22:35:34 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:34.599774 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-38eadd21-c67f-4ee7-b877-bd79cdcec9d2 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d24c940>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:34.628658 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-38eadd21-c67f-4ee7-b877-bd79cdcec9d2 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/c64c729b-ba76-44ef-8f09-779e2c6bc57c" status: 200 len: 286 microversion: 2.1 time: 0.032666 Jan 24 22:35:34.629400 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 536/1055] 10.222.0.84 () {58 vars in 1250 bytes} [Mon Jan 24 22:35:34 2022] GET /compute/v2.1/os-snapshots/c64c729b-ba76-44ef-8f09-779e2c6bc57c => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:34.748332 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6e8f6c34-8c99-4061-826f-07ea17f5d063 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:34.750104 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6e8f6c34-8c99-4061-826f-07ea17f5d063 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:34.756409 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6e8f6c34-8c99-4061-826f-07ea17f5d063 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:34.756868 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6e8f6c34-8c99-4061-826f-07ea17f5d063 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:34.757682 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6e8f6c34-8c99-4061-826f-07ea17f5d063 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:34.758105 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6e8f6c34-8c99-4061-826f-07ea17f5d063 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:34.787940 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6e8f6c34-8c99-4061-826f-07ea17f5d063 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044095 Jan 24 22:35:34.788787 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 520/1056] 10.222.0.84 () {58 vars in 1301 bytes} [Mon Jan 24 22:35:34 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 22:35:34.799650 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-90ec8fa0-f647-41e1-9c06-95f6afc2701e tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:34.800328 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-90ec8fa0-f647-41e1-9c06-95f6afc2701e tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:34.806854 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-90ec8fa0-f647-41e1-9c06-95f6afc2701e tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:34.807367 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-90ec8fa0-f647-41e1-9c06-95f6afc2701e tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:34.808164 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-90ec8fa0-f647-41e1-9c06-95f6afc2701e tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:34.808677 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-90ec8fa0-f647-41e1-9c06-95f6afc2701e tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:34.888499 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-90ec8fa0-f647-41e1-9c06-95f6afc2701e tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] HTTP exception thrown: Instance cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 is not attached to volume 8d0ee76b-2b62-4547-8545-857a18f50903 Jan 24 22:35:34.889132 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-90ec8fa0-f647-41e1-9c06-95f6afc2701e tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Returning 404 to user: Instance cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 is not attached to volume 8d0ee76b-2b62-4547-8545-857a18f50903 {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:35:34.889958 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-90ec8fa0-f647-41e1-9c06-95f6afc2701e tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "DELETE /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/os-volume_attachments/8d0ee76b-2b62-4547-8545-857a18f50903" status: 404 len: 154 microversion: 2.1 time: 0.095166 Jan 24 22:35:34.890559 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 537/1057] 10.222.0.84 () {58 vars in 1415 bytes} [Mon Jan 24 22:35:34 2022] DELETE /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46/os-volume_attachments/8d0ee76b-2b62-4547-8545-857a18f50903 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 24 22:35:35.645709 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-726ccb6e-f55e-4814-85a3-511fcd9d3181 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d193310>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:35.679555 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-726ccb6e-f55e-4814-85a3-511fcd9d3181 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/c64c729b-ba76-44ef-8f09-779e2c6bc57c" status: 200 len: 286 microversion: 2.1 time: 0.039810 Jan 24 22:35:35.680564 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 521/1058] 10.222.0.84 () {58 vars in 1250 bytes} [Mon Jan 24 22:35:35 2022] GET /compute/v2.1/os-snapshots/c64c729b-ba76-44ef-8f09-779e2c6bc57c => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:36.696796 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-947132c5-703f-4b36-8a1c-0ef4c87d476b tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d2b90d0>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:36.728112 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-947132c5-703f-4b36-8a1c-0ef4c87d476b tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/c64c729b-ba76-44ef-8f09-779e2c6bc57c" status: 200 len: 286 microversion: 2.1 time: 0.037247 Jan 24 22:35:36.728658 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 538/1059] 10.222.0.84 () {58 vars in 1250 bytes} [Mon Jan 24 22:35:36 2022] GET /compute/v2.1/os-snapshots/c64c729b-ba76-44ef-8f09-779e2c6bc57c => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:37.741089 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-f4766dea-d341-4cab-83d9-16e20de8f22f tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d15cd30>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:37.776242 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-f4766dea-d341-4cab-83d9-16e20de8f22f tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/c64c729b-ba76-44ef-8f09-779e2c6bc57c" status: 200 len: 287 microversion: 2.1 time: 0.039484 Jan 24 22:35:37.776790 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 522/1060] 10.222.0.84 () {58 vars in 1250 bytes} [Mon Jan 24 22:35:37 2022] GET /compute/v2.1/os-snapshots/c64c729b-ba76-44ef-8f09-779e2c6bc57c => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:37.788342 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-aae7d905-348a-49fb-9786-44a7a6b7cab9 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d25fe50>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:37.846272 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-aae7d905-348a-49fb-9786-44a7a6b7cab9 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "DELETE /compute/v2.1/os-snapshots/c64c729b-ba76-44ef-8f09-779e2c6bc57c" status: 202 len: 0 microversion: 2.1 time: 0.062033 Jan 24 22:35:37.847068 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 539/1061] 10.222.0.84 () {58 vars in 1253 bytes} [Mon Jan 24 22:35:37 2022] DELETE /compute/v2.1/os-snapshots/c64c729b-ba76-44ef-8f09-779e2c6bc57c => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:35:37.857831 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-0b698e9f-5d6e-4ca6-a06e-8426c640b5c9 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d136670>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:37.891788 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-0b698e9f-5d6e-4ca6-a06e-8426c640b5c9 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/c64c729b-ba76-44ef-8f09-779e2c6bc57c" status: 200 len: 286 microversion: 2.1 time: 0.039667 Jan 24 22:35:37.892343 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 523/1062] 10.222.0.84 () {58 vars in 1250 bytes} [Mon Jan 24 22:35:37 2022] GET /compute/v2.1/os-snapshots/c64c729b-ba76-44ef-8f09-779e2c6bc57c => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:35:38.133482 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-13e2e3e1-2b82-43cb-9a08-cdddd963dab8 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:38.134030 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-13e2e3e1-2b82-43cb-9a08-cdddd963dab8 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:38.140691 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-13e2e3e1-2b82-43cb-9a08-cdddd963dab8 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:38.141435 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-13e2e3e1-2b82-43cb-9a08-cdddd963dab8 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:38.142245 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-13e2e3e1-2b82-43cb-9a08-cdddd963dab8 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:38.142619 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-13e2e3e1-2b82-43cb-9a08-cdddd963dab8 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:38.168503 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-13e2e3e1-2b82-43cb-9a08-cdddd963dab8 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Going to try to terminate instance {{(pid=116467) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:35:38.248164 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-13e2e3e1-2b82-43cb-9a08-cdddd963dab8 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "DELETE /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 204 len: 0 microversion: 2.1 time: 0.117599 Jan 24 22:35:38.248732 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 540/1063] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:35:38 2022] DELETE /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:35:38.257495 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e4baea44-1ba0-47f8-9f82-d9dceef5a2b0 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:38.258085 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e4baea44-1ba0-47f8-9f82-d9dceef5a2b0 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:38.264367 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e4baea44-1ba0-47f8-9f82-d9dceef5a2b0 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:38.265015 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e4baea44-1ba0-47f8-9f82-d9dceef5a2b0 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:38.265999 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e4baea44-1ba0-47f8-9f82-d9dceef5a2b0 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:38.266420 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e4baea44-1ba0-47f8-9f82-d9dceef5a2b0 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:38.642588 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e4baea44-1ba0-47f8-9f82-d9dceef5a2b0 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:38.649985 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e4baea44-1ba0-47f8-9f82-d9dceef5a2b0 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1554 microversion: 2.1 time: 0.396222 Jan 24 22:35:38.650517 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 524/1064] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:38 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1554 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:35:38.904293 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6d3c189e-b001-4e45-8817-3255bd242c48 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d143040>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:38.928829 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-6d3c189e-b001-4e45-8817-3255bd242c48 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] HTTP exception thrown: Snapshot c64c729b-ba76-44ef-8f09-779e2c6bc57c could not be found. Jan 24 22:35:38.929461 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6d3c189e-b001-4e45-8817-3255bd242c48 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Returning 404 to user: Snapshot c64c729b-ba76-44ef-8f09-779e2c6bc57c could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:35:38.930277 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6d3c189e-b001-4e45-8817-3255bd242c48 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "GET /compute/v2.1/os-snapshots/c64c729b-ba76-44ef-8f09-779e2c6bc57c" status: 404 len: 111 microversion: 2.1 time: 0.030080 Jan 24 22:35:38.930808 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 541/1065] 10.222.0.84 () {58 vars in 1250 bytes} [Mon Jan 24 22:35:38 2022] GET /compute/v2.1/os-snapshots/c64c729b-ba76-44ef-8f09-779e2c6bc57c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:35:38.939324 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-84039fff-7d3f-42be-8c96-8664fc3c08c4 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d1363a0>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:39.002034 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-84039fff-7d3f-42be-8c96-8664fc3c08c4 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21" status: 202 len: 0 microversion: 2.1 time: 0.066709 Jan 24 22:35:39.003017 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 525/1066] 10.222.0.84 () {58 vars in 1247 bytes} [Mon Jan 24 22:35:38 2022] DELETE /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:35:39.015612 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-069aaef2-8e53-40d3-b3b5-159fb977cadd tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d127f70>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:39.066437 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-069aaef2-8e53-40d3-b3b5-159fb977cadd tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21" status: 200 len: 344 microversion: 2.1 time: 0.057472 Jan 24 22:35:39.067116 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 542/1067] 10.222.0.84 () {58 vars in 1244 bytes} [Mon Jan 24 22:35:39 2022] GET /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:39.667324 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b51463af-4f26-4769-823f-105ae249643d tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:39.667926 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b51463af-4f26-4769-823f-105ae249643d tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:39.674775 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b51463af-4f26-4769-823f-105ae249643d tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:39.675257 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b51463af-4f26-4769-823f-105ae249643d tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:39.676051 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b51463af-4f26-4769-823f-105ae249643d tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:39.676475 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b51463af-4f26-4769-823f-105ae249643d tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:39.828768 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b51463af-4f26-4769-823f-105ae249643d tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:39.836820 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b51463af-4f26-4769-823f-105ae249643d tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1554 microversion: 2.1 time: 0.173205 Jan 24 22:35:39.837356 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 526/1068] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:39 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:35:40.083891 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-8cb48911-5882-4820-83d9-aa6fcef4742c tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d2b9430>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:40.115128 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-8cb48911-5882-4820-83d9-aa6fcef4742c tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] HTTP exception thrown: Volume 71d4b826-056c-40ef-97ab-5389410cac21 could not be found. Jan 24 22:35:40.115710 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-8cb48911-5882-4820-83d9-aa6fcef4742c tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Returning 404 to user: Volume 71d4b826-056c-40ef-97ab-5389410cac21 could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:35:40.116537 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-8cb48911-5882-4820-83d9-aa6fcef4742c tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21" status: 404 len: 109 microversion: 2.1 time: 0.039879 Jan 24 22:35:40.117095 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 543/1069] 10.222.0.84 () {58 vars in 1244 bytes} [Mon Jan 24 22:35:40 2022] GET /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:35:40.130995 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-f44f6a65-815f-476a-a458-6f9c10341ddb tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d193310>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:40.157861 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-f44f6a65-815f-476a-a458-6f9c10341ddb tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] HTTP exception thrown: Volume 71d4b826-056c-40ef-97ab-5389410cac21 could not be found. Jan 24 22:35:40.158454 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-f44f6a65-815f-476a-a458-6f9c10341ddb tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Returning 404 to user: Volume 71d4b826-056c-40ef-97ab-5389410cac21 could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:35:40.159274 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-f44f6a65-815f-476a-a458-6f9c10341ddb tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "DELETE /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21" status: 404 len: 109 microversion: 2.1 time: 0.032342 Jan 24 22:35:40.159802 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 527/1070] 10.222.0.84 () {58 vars in 1247 bytes} [Mon Jan 24 22:35:40 2022] DELETE /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:35:40.167705 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4d92a1ac-4cde-4bc2-8a6b-4ff98e8a7723 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Calling method '.version_select at 0x7f7e5d24c790>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:40.194612 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-4d92a1ac-4cde-4bc2-8a6b-4ff98e8a7723 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] HTTP exception thrown: Volume 71d4b826-056c-40ef-97ab-5389410cac21 could not be found. Jan 24 22:35:40.195189 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4d92a1ac-4cde-4bc2-8a6b-4ff98e8a7723 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] Returning 404 to user: Volume 71d4b826-056c-40ef-97ab-5389410cac21 could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:35:40.196003 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4d92a1ac-4cde-4bc2-8a6b-4ff98e8a7723 tempest-VolumesSnapshotsTestJSON-920721354 tempest-VolumesSnapshotsTestJSON-920721354-project] 10.222.0.84 "GET /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21" status: 404 len: 109 microversion: 2.1 time: 0.032105 Jan 24 22:35:40.196527 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 544/1071] 10.222.0.84 () {58 vars in 1244 bytes} [Mon Jan 24 22:35:40 2022] GET /compute/v2.1/os-volumes/71d4b826-056c-40ef-97ab-5389410cac21 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:35:40.726613 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-6c826cb7-ce3e-44a7-8a36-027a5bfeebf3 req-59fd4ce3-b1f5-4373-a01a-d0ba291c12b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbc89f6f-34dd-4831-8df6-a7d8b77c4b46", "name": "network-vif-deleted", "tag": "5c4e0fd6-fbad-4f01-a8ef-287b2802e9e6"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:35:40.731088 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:35:40.731088 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:35:40.750995 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-6c826cb7-ce3e-44a7-8a36-027a5bfeebf3 req-59fd4ce3-b1f5-4373-a01a-d0ba291c12b7 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:40.751768 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-6c826cb7-ce3e-44a7-8a36-027a5bfeebf3 req-59fd4ce3-b1f5-4373-a01a-d0ba291c12b7 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:40.788405 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-6c826cb7-ce3e-44a7-8a36-027a5bfeebf3 req-59fd4ce3-b1f5-4373-a01a-d0ba291c12b7 service nova] Creating event network-vif-deleted:5c4e0fd6-fbad-4f01-a8ef-287b2802e9e6 for instance cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 on hv-cinder-81322 Jan 24 22:35:40.793979 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-6c826cb7-ce3e-44a7-8a36-027a5bfeebf3 req-59fd4ce3-b1f5-4373-a01a-d0ba291c12b7 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080531 Jan 24 22:35:40.794955 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 528/1072] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:35:40.854033 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3f21f916-06c3-436e-b05a-ca215e4f514f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:40.855074 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-3f21f916-06c3-436e-b05a-ca215e4f514f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:40.861893 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3f21f916-06c3-436e-b05a-ca215e4f514f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:40.862599 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3f21f916-06c3-436e-b05a-ca215e4f514f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:40.863646 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3f21f916-06c3-436e-b05a-ca215e4f514f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:40.864279 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3f21f916-06c3-436e-b05a-ca215e4f514f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:40.898327 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3f21f916-06c3-436e-b05a-ca215e4f514f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:40.898811 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3f21f916-06c3-436e-b05a-ca215e4f514f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:40.899201 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.objects.instance [None req-3f21f916-06c3-436e-b05a-ca215e4f514f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lazy-loading 'fault' on Instance uuid cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 {{(pid=116467) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:35:40.941298 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3f21f916-06c3-436e-b05a-ca215e4f514f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2638a34c8b4cb0bc4149d4c061835d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f09686992a4d389c166bb0f9704e4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:40.948788 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-3f21f916-06c3-436e-b05a-ca215e4f514f tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 200 len: 1349 microversion: 2.1 time: 0.098876 Jan 24 22:35:40.958499 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 545/1073] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:40 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:35:41.967394 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1f1b0a2a-741e-4f65-a82a-3260c09bdc03 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:41.968217 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-1f1b0a2a-741e-4f65-a82a-3260c09bdc03 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] [instance: cbc89f6f-34dd-4831-8df6-a7d8b77c4b46] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:41.974481 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1f1b0a2a-741e-4f65-a82a-3260c09bdc03 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:41.974922 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1f1b0a2a-741e-4f65-a82a-3260c09bdc03 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:41.975705 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1f1b0a2a-741e-4f65-a82a-3260c09bdc03 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:41.976166 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1f1b0a2a-741e-4f65-a82a-3260c09bdc03 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:41.989694 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-1f1b0a2a-741e-4f65-a82a-3260c09bdc03 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] HTTP exception thrown: Instance cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 could not be found. Jan 24 22:35:41.990293 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1f1b0a2a-741e-4f65-a82a-3260c09bdc03 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Returning 404 to user: Instance cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:35:41.991134 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-1f1b0a2a-741e-4f65-a82a-3260c09bdc03 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46" status: 404 len: 111 microversion: 2.1 time: 0.028781 Jan 24 22:35:41.991641 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 529/1074] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:41 2022] GET /compute/v2.1/servers/cbc89f6f-34dd-4831-8df6-a7d8b77c4b46 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:35:41.999859 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-67de89f0-c112-4109-8cb6-fd81f202ecd5 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] Calling method '.version_select at 0x7f7e5d28d5e0>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:42.019705 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-67de89f0-c112-4109-8cb6-fd81f202ecd5 tempest-TestMinimumBasicScenario-32879025 tempest-TestMinimumBasicScenario-32879025-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1311276800" status: 202 len: 0 microversion: 2.1 time: 0.023521 Jan 24 22:35:42.020306 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 546/1075] 10.222.0.84 () {58 vars in 1271 bytes} [Mon Jan 24 22:35:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1311276800 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:35:42.668039 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c49105c6-cd9b-4cb1-b730-76ba0ee97418 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:35:42.668649 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c49105c6-cd9b-4cb1-b730-76ba0ee97418 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:42.684402 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c49105c6-cd9b-4cb1-b730-76ba0ee97418 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:42.684891 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c49105c6-cd9b-4cb1-b730-76ba0ee97418 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:42.685639 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c49105c6-cd9b-4cb1-b730-76ba0ee97418 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:42.686065 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c49105c6-cd9b-4cb1-b730-76ba0ee97418 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:42.710574 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.objects.instance [None req-c49105c6-cd9b-4cb1-b730-76ba0ee97418 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lazy-loading 'flavor' on Instance uuid ab1d2298-3059-437a-9f1a-6173d40e21ca {{(pid=116466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 22:35:42.796710 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c49105c6-cd9b-4cb1-b730-76ba0ee97418 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "POST /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca/action" status: 202 len: 0 microversion: 2.1 time: 0.133577 Jan 24 22:35:42.797989 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 530/1076] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:35:42 2022] POST /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:35:42.807293 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4206bf34-b120-4e52-a733-de7c2047b847 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:42.808768 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4206bf34-b120-4e52-a733-de7c2047b847 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:42.826845 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4206bf34-b120-4e52-a733-de7c2047b847 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:42.827523 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4206bf34-b120-4e52-a733-de7c2047b847 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:42.828324 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4206bf34-b120-4e52-a733-de7c2047b847 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:42.830364 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4206bf34-b120-4e52-a733-de7c2047b847 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:43.090957 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4206bf34-b120-4e52-a733-de7c2047b847 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:43.126989 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4206bf34-b120-4e52-a733-de7c2047b847 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1569 microversion: 2.1 time: 0.324589 Jan 24 22:35:43.135542 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 547/1077] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:42 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1569 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:35:44.153672 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-f881464f-f0eb-4f90-a215-fb0718ee8ec0 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:44.153672 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-f881464f-f0eb-4f90-a215-fb0718ee8ec0 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:44.161327 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f881464f-f0eb-4f90-a215-fb0718ee8ec0 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:44.161859 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f881464f-f0eb-4f90-a215-fb0718ee8ec0 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:44.162742 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f881464f-f0eb-4f90-a215-fb0718ee8ec0 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:44.163255 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-f881464f-f0eb-4f90-a215-fb0718ee8ec0 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:44.393813 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-f881464f-f0eb-4f90-a215-fb0718ee8ec0 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:44.405598 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-f881464f-f0eb-4f90-a215-fb0718ee8ec0 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1569 microversion: 2.1 time: 0.263448 Jan 24 22:35:44.406183 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 531/1078] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:44 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1569 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:35:45.423559 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ea884bdb-12a8-49e6-b68d-28b6a3ab76fa tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:45.428043 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ea884bdb-12a8-49e6-b68d-28b6a3ab76fa tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:45.435829 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ea884bdb-12a8-49e6-b68d-28b6a3ab76fa tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:45.436613 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ea884bdb-12a8-49e6-b68d-28b6a3ab76fa tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:45.437607 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ea884bdb-12a8-49e6-b68d-28b6a3ab76fa tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:45.438198 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ea884bdb-12a8-49e6-b68d-28b6a3ab76fa tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:45.709147 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-ea884bdb-12a8-49e6-b68d-28b6a3ab76fa tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:45.716816 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ea884bdb-12a8-49e6-b68d-28b6a3ab76fa tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1569 microversion: 2.1 time: 0.297277 Jan 24 22:35:45.717412 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 548/1079] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:45 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1569 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:35:46.734569 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-83278cbb-4a4d-49c0-bbdf-140988c2a2a0 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:46.735279 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-83278cbb-4a4d-49c0-bbdf-140988c2a2a0 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:46.742481 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-83278cbb-4a4d-49c0-bbdf-140988c2a2a0 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:46.743219 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-83278cbb-4a4d-49c0-bbdf-140988c2a2a0 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:46.744202 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-83278cbb-4a4d-49c0-bbdf-140988c2a2a0 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:46.744612 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-83278cbb-4a4d-49c0-bbdf-140988c2a2a0 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:46.991341 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-83278cbb-4a4d-49c0-bbdf-140988c2a2a0 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:47.001719 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-83278cbb-4a4d-49c0-bbdf-140988c2a2a0 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1569 microversion: 2.1 time: 0.271739 Jan 24 22:35:47.002649 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 532/1080] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:46 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1569 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:35:48.019749 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6de162d1-fb99-4093-b59f-a7adda0c7ccd tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:48.020482 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6de162d1-fb99-4093-b59f-a7adda0c7ccd tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:48.027242 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6de162d1-fb99-4093-b59f-a7adda0c7ccd tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:48.027695 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6de162d1-fb99-4093-b59f-a7adda0c7ccd tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:48.028562 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6de162d1-fb99-4093-b59f-a7adda0c7ccd tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:48.028898 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6de162d1-fb99-4093-b59f-a7adda0c7ccd tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:48.248606 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6de162d1-fb99-4093-b59f-a7adda0c7ccd tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:48.259142 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6de162d1-fb99-4093-b59f-a7adda0c7ccd tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1569 microversion: 2.1 time: 0.243120 Jan 24 22:35:48.270237 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 549/1081] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:48 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1569 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:35:49.276330 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-8269c61f-fe3d-4e32-9b29-d616f2825346 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:49.277632 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-8269c61f-fe3d-4e32-9b29-d616f2825346 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:49.284517 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8269c61f-fe3d-4e32-9b29-d616f2825346 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:49.285332 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8269c61f-fe3d-4e32-9b29-d616f2825346 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:49.286088 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8269c61f-fe3d-4e32-9b29-d616f2825346 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:49.286771 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-8269c61f-fe3d-4e32-9b29-d616f2825346 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:49.447159 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-8269c61f-fe3d-4e32-9b29-d616f2825346 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:49.455241 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-8269c61f-fe3d-4e32-9b29-d616f2825346 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1569 microversion: 2.1 time: 0.182622 Jan 24 22:35:49.455890 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 533/1082] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:49 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:35:50.471578 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-710db635-4a97-4693-a234-e3b951f2aaa6 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:50.472143 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-710db635-4a97-4693-a234-e3b951f2aaa6 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:50.478265 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-710db635-4a97-4693-a234-e3b951f2aaa6 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:50.478707 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-710db635-4a97-4693-a234-e3b951f2aaa6 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:50.479544 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-710db635-4a97-4693-a234-e3b951f2aaa6 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:50.480143 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-710db635-4a97-4693-a234-e3b951f2aaa6 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:50.617505 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-710db635-4a97-4693-a234-e3b951f2aaa6 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:50.625014 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-710db635-4a97-4693-a234-e3b951f2aaa6 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1569 microversion: 2.1 time: 0.157100 Jan 24 22:35:50.625577 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 550/1083] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:50 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:35:51.645057 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e5eaf618-54a8-4282-a849-458603edeb4f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:51.645820 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e5eaf618-54a8-4282-a849-458603edeb4f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:51.655280 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e5eaf618-54a8-4282-a849-458603edeb4f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:51.655730 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e5eaf618-54a8-4282-a849-458603edeb4f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:51.656876 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e5eaf618-54a8-4282-a849-458603edeb4f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:51.657583 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e5eaf618-54a8-4282-a849-458603edeb4f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:51.809154 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e5eaf618-54a8-4282-a849-458603edeb4f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:51.820469 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e5eaf618-54a8-4282-a849-458603edeb4f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1569 microversion: 2.1 time: 0.181077 Jan 24 22:35:51.821034 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 534/1084] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:51 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:35:52.841360 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-092df883-7d45-47fc-951d-b7306786aa03 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:52.841959 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-092df883-7d45-47fc-951d-b7306786aa03 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:52.849015 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-092df883-7d45-47fc-951d-b7306786aa03 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:52.849601 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-092df883-7d45-47fc-951d-b7306786aa03 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:52.850785 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-092df883-7d45-47fc-951d-b7306786aa03 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:52.851355 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-092df883-7d45-47fc-951d-b7306786aa03 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:52.993160 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-092df883-7d45-47fc-951d-b7306786aa03 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:53.001126 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-092df883-7d45-47fc-951d-b7306786aa03 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1569 microversion: 2.1 time: 0.163574 Jan 24 22:35:53.001697 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 551/1085] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:52 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:35:54.018649 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a372c2d0-4773-47e6-9498-b22661173c32 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:54.019234 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a372c2d0-4773-47e6-9498-b22661173c32 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:54.025650 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a372c2d0-4773-47e6-9498-b22661173c32 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:54.026099 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a372c2d0-4773-47e6-9498-b22661173c32 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:54.026869 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a372c2d0-4773-47e6-9498-b22661173c32 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:54.027309 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a372c2d0-4773-47e6-9498-b22661173c32 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:54.167636 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a372c2d0-4773-47e6-9498-b22661173c32 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:54.176219 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a372c2d0-4773-47e6-9498-b22661173c32 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1569 microversion: 2.1 time: 0.161295 Jan 24 22:35:54.177658 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 535/1086] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:54 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:35:55.198813 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-059dddc2-0725-4350-ad2a-579054db636e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:55.199776 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-059dddc2-0725-4350-ad2a-579054db636e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:55.208467 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-059dddc2-0725-4350-ad2a-579054db636e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:55.208918 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-059dddc2-0725-4350-ad2a-579054db636e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:55.209733 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-059dddc2-0725-4350-ad2a-579054db636e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:55.210160 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-059dddc2-0725-4350-ad2a-579054db636e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:55.363207 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-059dddc2-0725-4350-ad2a-579054db636e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:55.371837 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-059dddc2-0725-4350-ad2a-579054db636e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1569 microversion: 2.1 time: 0.179208 Jan 24 22:35:55.372543 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 552/1087] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:55 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:35:56.390041 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-98e1ab96-4bf4-46c6-ab57-82535ba4776f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:56.390637 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-98e1ab96-4bf4-46c6-ab57-82535ba4776f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:56.397622 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-98e1ab96-4bf4-46c6-ab57-82535ba4776f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:56.398061 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-98e1ab96-4bf4-46c6-ab57-82535ba4776f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:56.399016 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-98e1ab96-4bf4-46c6-ab57-82535ba4776f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:56.399505 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-98e1ab96-4bf4-46c6-ab57-82535ba4776f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:56.573478 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-98e1ab96-4bf4-46c6-ab57-82535ba4776f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:56.581834 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-98e1ab96-4bf4-46c6-ab57-82535ba4776f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1510 microversion: 2.1 time: 0.195712 Jan 24 22:35:56.587063 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 536/1088] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:56 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:35:56.598266 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-125a33c6-17c6-4996-9fb6-7155533a6dad tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:35:56.599400 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-125a33c6-17c6-4996-9fb6-7155533a6dad tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:56.605739 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-125a33c6-17c6-4996-9fb6-7155533a6dad tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:56.606415 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-125a33c6-17c6-4996-9fb6-7155533a6dad tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:56.607199 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-125a33c6-17c6-4996-9fb6-7155533a6dad tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:56.607619 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-125a33c6-17c6-4996-9fb6-7155533a6dad tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:56.704667 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: ERROR oslo.messaging._drivers.impl_rabbit [None req-125a33c6-17c6-4996-9fb6-7155533a6dad tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [fe1ee38b-9252-4c90-9886-a193b38de89c] AMQP server on 10.222.0.84:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 24 22:35:57.706433 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO oslo.messaging._drivers.impl_rabbit [None req-125a33c6-17c6-4996-9fb6-7155533a6dad tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [fe1ee38b-9252-4c90-9886-a193b38de89c] Reconnected to AMQP server on 10.222.0.84:5672 via [amqp] client with port 59576. Jan 24 22:35:57.710635 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-125a33c6-17c6-4996-9fb6-7155533a6dad tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "POST /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca/action" status: 202 len: 0 microversion: 2.1 time: 1.116168 Jan 24 22:35:57.711253 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 553/1089] 10.222.0.84 () {60 vars in 1277 bytes} [Mon Jan 24 22:35:56 2022] POST /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca/action => generated 0 bytes in 1118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:35:57.719201 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-120f650e-b017-458b-b472-02e1fe1e05a3 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:57.719817 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-120f650e-b017-458b-b472-02e1fe1e05a3 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:57.729659 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-120f650e-b017-458b-b472-02e1fe1e05a3 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:57.730200 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-120f650e-b017-458b-b472-02e1fe1e05a3 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:57.730999 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-120f650e-b017-458b-b472-02e1fe1e05a3 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:57.731429 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-120f650e-b017-458b-b472-02e1fe1e05a3 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:57.888708 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-120f650e-b017-458b-b472-02e1fe1e05a3 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:57.896473 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-120f650e-b017-458b-b472-02e1fe1e05a3 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1518 microversion: 2.1 time: 0.180930 Jan 24 22:35:57.897075 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 537/1090] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:57 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:35:58.626467 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-452bcc30-9378-4f85-8fb2-6cd10c26a660 req-7f2a4ef5-b746-4eed-b215-d533781adcc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1d2298-3059-437a-9f1a-6173d40e21ca", "name": "network-vif-unplugged", "status": "completed", "tag": "4b3048ce-5caa-49ca-82eb-b694366739aa"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:35:58.629395 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:35:58.629395 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:35:58.638648 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-452bcc30-9378-4f85-8fb2-6cd10c26a660 req-7f2a4ef5-b746-4eed-b215-d533781adcc5 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:58.639211 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-452bcc30-9378-4f85-8fb2-6cd10c26a660 req-7f2a4ef5-b746-4eed-b215-d533781adcc5 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:58.653585 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.compute.server_external_events [req-452bcc30-9378-4f85-8fb2-6cd10c26a660 req-7f2a4ef5-b746-4eed-b215-d533781adcc5 service nova] Unable to find a host for instance ab1d2298-3059-437a-9f1a-6173d40e21ca. Dropping event network-vif-unplugged {{(pid=116467) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 24 22:35:58.654483 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-452bcc30-9378-4f85-8fb2-6cd10c26a660 req-7f2a4ef5-b746-4eed-b215-d533781adcc5 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032418 Jan 24 22:35:58.655075 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 554/1091] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 24 22:35:58.915016 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-66e5f429-a1d5-4d4b-9b5e-42dd53183dd1 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:35:58.915628 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-66e5f429-a1d5-4d4b-9b5e-42dd53183dd1 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:35:58.923471 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-66e5f429-a1d5-4d4b-9b5e-42dd53183dd1 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:58.924864 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-66e5f429-a1d5-4d4b-9b5e-42dd53183dd1 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:58.925707 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-66e5f429-a1d5-4d4b-9b5e-42dd53183dd1 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:35:58.926130 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-66e5f429-a1d5-4d4b-9b5e-42dd53183dd1 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:35:59.069692 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-66e5f429-a1d5-4d4b-9b5e-42dd53183dd1 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:35:59.077528 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-66e5f429-a1d5-4d4b-9b5e-42dd53183dd1 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1518 microversion: 2.1 time: 0.166078 Jan 24 22:35:59.078441 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 538/1092] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:35:58 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:00.094735 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-44599217-fa25-4680-adf3-f82d14366ee4 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:00.095720 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-44599217-fa25-4680-adf3-f82d14366ee4 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:00.103743 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-44599217-fa25-4680-adf3-f82d14366ee4 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:00.104522 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-44599217-fa25-4680-adf3-f82d14366ee4 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:00.110490 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-44599217-fa25-4680-adf3-f82d14366ee4 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:00.110929 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-44599217-fa25-4680-adf3-f82d14366ee4 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:00.270480 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-44599217-fa25-4680-adf3-f82d14366ee4 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:00.278140 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-44599217-fa25-4680-adf3-f82d14366ee4 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1518 microversion: 2.1 time: 0.187068 Jan 24 22:36:00.278706 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 555/1093] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:00 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1518 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:01.298771 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6b5d5b25-bc71-45ec-b453-d8030d1bca69 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:01.301962 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-6b5d5b25-bc71-45ec-b453-d8030d1bca69 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:01.309670 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6b5d5b25-bc71-45ec-b453-d8030d1bca69 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:01.310249 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6b5d5b25-bc71-45ec-b453-d8030d1bca69 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:01.311212 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6b5d5b25-bc71-45ec-b453-d8030d1bca69 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:01.311856 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-6b5d5b25-bc71-45ec-b453-d8030d1bca69 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:01.450075 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-6b5d5b25-bc71-45ec-b453-d8030d1bca69 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:01.457443 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6b5d5b25-bc71-45ec-b453-d8030d1bca69 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1518 microversion: 2.1 time: 0.164954 Jan 24 22:36:01.458007 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 539/1094] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:01 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:02.481177 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1585a29e-f553-4115-aee8-12c7f7bbd7dd tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:02.481884 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1585a29e-f553-4115-aee8-12c7f7bbd7dd tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:02.490090 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1585a29e-f553-4115-aee8-12c7f7bbd7dd tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:02.490831 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1585a29e-f553-4115-aee8-12c7f7bbd7dd tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:02.491846 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1585a29e-f553-4115-aee8-12c7f7bbd7dd tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:02.497594 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1585a29e-f553-4115-aee8-12c7f7bbd7dd tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:02.650556 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1585a29e-f553-4115-aee8-12c7f7bbd7dd tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:02.658378 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1585a29e-f553-4115-aee8-12c7f7bbd7dd tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1520 microversion: 2.1 time: 0.186951 Jan 24 22:36:02.658992 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 556/1095] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:02 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:03.676307 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b7000a26-78c0-44f8-a32d-f86f47fa38a1 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:03.677018 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b7000a26-78c0-44f8-a32d-f86f47fa38a1 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:03.684589 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b7000a26-78c0-44f8-a32d-f86f47fa38a1 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:03.685027 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b7000a26-78c0-44f8-a32d-f86f47fa38a1 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:03.686043 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b7000a26-78c0-44f8-a32d-f86f47fa38a1 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:03.686483 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b7000a26-78c0-44f8-a32d-f86f47fa38a1 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:03.828411 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b7000a26-78c0-44f8-a32d-f86f47fa38a1 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:03.835972 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b7000a26-78c0-44f8-a32d-f86f47fa38a1 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1576 microversion: 2.1 time: 0.164170 Jan 24 22:36:03.836633 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 540/1096] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:03 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:04.853274 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-e5c096f4-1318-4a0c-a78d-8a58845db9fa tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:04.853881 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-e5c096f4-1318-4a0c-a78d-8a58845db9fa tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:04.861150 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e5c096f4-1318-4a0c-a78d-8a58845db9fa tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:04.861828 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e5c096f4-1318-4a0c-a78d-8a58845db9fa tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:04.863297 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e5c096f4-1318-4a0c-a78d-8a58845db9fa tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:04.863767 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-e5c096f4-1318-4a0c-a78d-8a58845db9fa tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:05.001831 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-e5c096f4-1318-4a0c-a78d-8a58845db9fa tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:05.009729 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-e5c096f4-1318-4a0c-a78d-8a58845db9fa tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1576 microversion: 2.1 time: 0.160282 Jan 24 22:36:05.010305 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 557/1097] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:04 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:06.026715 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-cf3a2408-8111-455f-8adb-6e9e52a35095 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:06.027317 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-cf3a2408-8111-455f-8adb-6e9e52a35095 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:06.033568 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cf3a2408-8111-455f-8adb-6e9e52a35095 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:06.034058 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cf3a2408-8111-455f-8adb-6e9e52a35095 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:06.034945 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cf3a2408-8111-455f-8adb-6e9e52a35095 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:06.035376 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-cf3a2408-8111-455f-8adb-6e9e52a35095 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:06.494056 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-cf3a2408-8111-455f-8adb-6e9e52a35095 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:06.502352 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-cf3a2408-8111-455f-8adb-6e9e52a35095 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1576 microversion: 2.1 time: 0.479445 Jan 24 22:36:06.502914 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 541/1098] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:06 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1576 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:07.523073 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-27b6deab-2e1f-4b92-8d9f-a8a2d1f50f58 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:07.523815 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-27b6deab-2e1f-4b92-8d9f-a8a2d1f50f58 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:07.530597 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-27b6deab-2e1f-4b92-8d9f-a8a2d1f50f58 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:07.531050 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-27b6deab-2e1f-4b92-8d9f-a8a2d1f50f58 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:07.531831 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-27b6deab-2e1f-4b92-8d9f-a8a2d1f50f58 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:07.532262 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-27b6deab-2e1f-4b92-8d9f-a8a2d1f50f58 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:07.732321 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-27b6deab-2e1f-4b92-8d9f-a8a2d1f50f58 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:07.740690 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-27b6deab-2e1f-4b92-8d9f-a8a2d1f50f58 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1576 microversion: 2.1 time: 0.222331 Jan 24 22:36:07.750202 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 558/1099] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:07 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1576 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:08.758725 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-54ee475e-95ce-4c9a-8989-303d0a724d7e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:08.759594 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-54ee475e-95ce-4c9a-8989-303d0a724d7e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:08.766194 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-54ee475e-95ce-4c9a-8989-303d0a724d7e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:08.766641 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-54ee475e-95ce-4c9a-8989-303d0a724d7e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:08.767426 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-54ee475e-95ce-4c9a-8989-303d0a724d7e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:08.767854 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-54ee475e-95ce-4c9a-8989-303d0a724d7e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:08.942156 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-54ee475e-95ce-4c9a-8989-303d0a724d7e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:08.950058 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-54ee475e-95ce-4c9a-8989-303d0a724d7e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1576 microversion: 2.1 time: 0.195080 Jan 24 22:36:08.950724 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 542/1100] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:08 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:09.968900 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c05f66c0-12b6-431c-aa5c-3573e0e68bed tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:09.969684 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c05f66c0-12b6-431c-aa5c-3573e0e68bed tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:09.977363 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c05f66c0-12b6-431c-aa5c-3573e0e68bed tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:09.977809 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c05f66c0-12b6-431c-aa5c-3573e0e68bed tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:09.978608 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c05f66c0-12b6-431c-aa5c-3573e0e68bed tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:09.979221 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c05f66c0-12b6-431c-aa5c-3573e0e68bed tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:10.254560 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-c05f66c0-12b6-431c-aa5c-3573e0e68bed tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:10.262623 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c05f66c0-12b6-431c-aa5c-3573e0e68bed tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1576 microversion: 2.1 time: 0.298477 Jan 24 22:36:10.263176 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 559/1101] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:09 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1576 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:11.279738 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-05864dc1-3774-4831-be1b-9bc1db3c1e24 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:11.280519 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-05864dc1-3774-4831-be1b-9bc1db3c1e24 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:11.301258 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-05864dc1-3774-4831-be1b-9bc1db3c1e24 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:11.301820 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-05864dc1-3774-4831-be1b-9bc1db3c1e24 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:11.302735 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-05864dc1-3774-4831-be1b-9bc1db3c1e24 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:11.305509 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-05864dc1-3774-4831-be1b-9bc1db3c1e24 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:11.552618 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-05864dc1-3774-4831-be1b-9bc1db3c1e24 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:11.562027 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-05864dc1-3774-4831-be1b-9bc1db3c1e24 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1576 microversion: 2.1 time: 0.286063 Jan 24 22:36:11.562612 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 543/1102] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:11 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1576 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:12.579601 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-863befaa-05a4-4515-a162-bec6b1ee39f3 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:12.580202 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-863befaa-05a4-4515-a162-bec6b1ee39f3 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:12.587411 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-863befaa-05a4-4515-a162-bec6b1ee39f3 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:12.587995 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-863befaa-05a4-4515-a162-bec6b1ee39f3 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:12.589062 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-863befaa-05a4-4515-a162-bec6b1ee39f3 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:12.589660 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-863befaa-05a4-4515-a162-bec6b1ee39f3 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:12.792605 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-863befaa-05a4-4515-a162-bec6b1ee39f3 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:12.802396 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-863befaa-05a4-4515-a162-bec6b1ee39f3 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1576 microversion: 2.1 time: 0.226490 Jan 24 22:36:12.803552 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 560/1103] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:12 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:12.818408 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-f846abaa-f0f5-416d-86da-f73bd9e5b173 req-6dae84af-426a-43c0-a628-69bbf8eb9d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1d2298-3059-437a-9f1a-6173d40e21ca", "name": "network-vif-plugged", "status": "completed", "tag": "4b3048ce-5caa-49ca-82eb-b694366739aa"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:36:12.820686 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:36:12.820686 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:36:12.836790 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-f846abaa-f0f5-416d-86da-f73bd9e5b173 req-6dae84af-426a-43c0-a628-69bbf8eb9d46 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:12.837346 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-f846abaa-f0f5-416d-86da-f73bd9e5b173 req-6dae84af-426a-43c0-a628-69bbf8eb9d46 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:12.851984 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-f846abaa-f0f5-416d-86da-f73bd9e5b173 req-6dae84af-426a-43c0-a628-69bbf8eb9d46 service nova] Creating event network-vif-plugged:4b3048ce-5caa-49ca-82eb-b694366739aa for instance ab1d2298-3059-437a-9f1a-6173d40e21ca on hv-cinder-81322 Jan 24 22:36:12.860390 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-f846abaa-f0f5-416d-86da-f73bd9e5b173 req-6dae84af-426a-43c0-a628-69bbf8eb9d46 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046334 Jan 24 22:36:12.861029 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 544/1104] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:36:13.820170 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1b5074bf-bca5-4df6-af44-cfeaf78c4e79 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:13.820784 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1b5074bf-bca5-4df6-af44-cfeaf78c4e79 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:13.827571 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1b5074bf-bca5-4df6-af44-cfeaf78c4e79 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:13.828242 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1b5074bf-bca5-4df6-af44-cfeaf78c4e79 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:13.829314 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1b5074bf-bca5-4df6-af44-cfeaf78c4e79 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:13.829861 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1b5074bf-bca5-4df6-af44-cfeaf78c4e79 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:14.029196 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1b5074bf-bca5-4df6-af44-cfeaf78c4e79 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:14.042374 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1b5074bf-bca5-4df6-af44-cfeaf78c4e79 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1576 microversion: 2.1 time: 0.225944 Jan 24 22:36:14.043214 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 561/1105] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:13 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:36:15.063540 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e5198350-3eec-45a4-8bf7-ee2c31ea22e7 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:15.064886 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e5198350-3eec-45a4-8bf7-ee2c31ea22e7 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:15.071672 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e5198350-3eec-45a4-8bf7-ee2c31ea22e7 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:15.072142 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e5198350-3eec-45a4-8bf7-ee2c31ea22e7 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:15.078828 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e5198350-3eec-45a4-8bf7-ee2c31ea22e7 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:15.079589 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e5198350-3eec-45a4-8bf7-ee2c31ea22e7 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:15.280347 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e5198350-3eec-45a4-8bf7-ee2c31ea22e7 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:15.288120 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e5198350-3eec-45a4-8bf7-ee2c31ea22e7 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1563 microversion: 2.1 time: 0.229009 Jan 24 22:36:15.288704 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 545/1106] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:15 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1563 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:16.846422 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-26d876f2-e0f0-443e-8e28-c6e5f844de07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Action: 'create', calling method: .version_select at 0x7f7e5d2a5310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1514835326"}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:36:16.860386 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-26d876f2-e0f0-443e-8e28-c6e5f844de07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Getting quotas for project 3e579d6f341241508dfd3800965f27c1. Resources: {'key_pairs'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:36:16.864824 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-26d876f2-e0f0-443e-8e28-c6e5f844de07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Getting quotas for user 6b9bf7472d3843efbcade92387a0ee09 and project 3e579d6f341241508dfd3800965f27c1. Resources: {'key_pairs'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:36:17.313056 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-26d876f2-e0f0-443e-8e28-c6e5f844de07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Getting quotas for project 3e579d6f341241508dfd3800965f27c1. Resources: {'key_pairs'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:36:17.317568 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-26d876f2-e0f0-443e-8e28-c6e5f844de07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Getting quotas for user 6b9bf7472d3843efbcade92387a0ee09 and project 3e579d6f341241508dfd3800965f27c1. Resources: {'key_pairs'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:36:17.334011 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-26d876f2-e0f0-443e-8e28-c6e5f844de07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.661762 Jan 24 22:36:17.334886 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 562/1107] 10.222.0.84 () {60 vars in 1157 bytes} [Mon Jan 24 22:36:16 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:24.288696 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 22:36:24.288696 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: Mon Jan 24 22:36:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 22:36:33.640475 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-4a691a61-2452-40cf-8c94-b0c7ff3ca0db tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1989927079", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1514835326", "security_groups": [{"name": "tempest-secgroup-smoke-11730502"}], "block_device_mapping_v2": [{"uuid": "f11232f6-77ce-42bd-89a9-c5ca538f7b87", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "04a2e7fe-f97a-4f14-b8ec-d5987baf93bb"}]}} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:36:33.758470 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.network.neutron [None req-4a691a61-2452-40cf-8c94-b0c7ff3ca0db tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] validate_networks() for [('04a2e7fe-f97a-4f14-b8ec-d5987baf93bb', None, None, None, None, None)] {{(pid=116466) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:36:34.126760 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-4a691a61-2452-40cf-8c94-b0c7ff3ca0db tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Flavor limits 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:36:34.127184 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-4a691a61-2452-40cf-8c94-b0c7ff3ca0db tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Image limits 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:36:34.127679 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-4a691a61-2452-40cf-8c94-b0c7ff3ca0db tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Flavor pref 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:36:34.128077 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-4a691a61-2452-40cf-8c94-b0c7ff3ca0db tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Image pref 0:0:0 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:36:34.128479 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.virt.hardware [None req-4a691a61-2452-40cf-8c94-b0c7ff3ca0db tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:36:34.138964 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4a691a61-2452-40cf-8c94-b0c7ff3ca0db tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:34.139402 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4a691a61-2452-40cf-8c94-b0c7ff3ca0db tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:34.140198 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4a691a61-2452-40cf-8c94-b0c7ff3ca0db tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:34.140651 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4a691a61-2452-40cf-8c94-b0c7ff3ca0db tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:34.160820 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-4a691a61-2452-40cf-8c94-b0c7ff3ca0db tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Getting quotas for project 3e579d6f341241508dfd3800965f27c1. Resources: {'cores', 'instances', 'ram'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:36:34.168261 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.quota [None req-4a691a61-2452-40cf-8c94-b0c7ff3ca0db tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Getting quotas for user 6b9bf7472d3843efbcade92387a0ee09 and project 3e579d6f341241508dfd3800965f27c1. Resources: {'cores', 'instances', 'ram'} {{(pid=116466) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:36:34.239306 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-4a691a61-2452-40cf-8c94-b0c7ff3ca0db tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Going to run 1 instances... {{(pid=116466) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:36:34.241569 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-4a691a61-2452-40cf-8c94-b0c7ff3ca0db tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f11232f6-77ce-42bd-89a9-c5ca538f7b87',volume_size=None,volume_type=None)] {{(pid=116466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:36:34.381713 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-4a691a61-2452-40cf-8c94-b0c7ff3ca0db tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.744744 Jan 24 22:36:34.382269 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 546/1108] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:36:33 2022] POST /compute/v2.1/servers => generated 404 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 24 22:36:34.397863 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-da1045c8-5d5b-4d29-80da-86c358a06953 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:34.398904 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-da1045c8-5d5b-4d29-80da-86c358a06953 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:34.454050 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-da1045c8-5d5b-4d29-80da-86c358a06953 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:34.460896 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-da1045c8-5d5b-4d29-80da-86c358a06953 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1095 microversion: 2.1 time: 0.071496 Jan 24 22:36:34.461603 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 563/1109] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:34 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:35.481731 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-4587d6e0-5fd8-4b02-a597-377ad64abbb2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:35.482412 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-4587d6e0-5fd8-4b02-a597-377ad64abbb2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:35.489257 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4587d6e0-5fd8-4b02-a597-377ad64abbb2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:35.489741 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4587d6e0-5fd8-4b02-a597-377ad64abbb2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:35.490569 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4587d6e0-5fd8-4b02-a597-377ad64abbb2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:35.491032 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-4587d6e0-5fd8-4b02-a597-377ad64abbb2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:35.554374 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-4587d6e0-5fd8-4b02-a597-377ad64abbb2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:35.562386 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-4587d6e0-5fd8-4b02-a597-377ad64abbb2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1193 microversion: 2.1 time: 0.086994 Jan 24 22:36:35.562947 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 547/1110] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:35 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:36.579852 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-524ea1a7-1a04-412c-9713-46fa500121e2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:36.580488 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-524ea1a7-1a04-412c-9713-46fa500121e2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:36.587545 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-524ea1a7-1a04-412c-9713-46fa500121e2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:36.588065 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-524ea1a7-1a04-412c-9713-46fa500121e2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:36.588937 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-524ea1a7-1a04-412c-9713-46fa500121e2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:36.589395 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-524ea1a7-1a04-412c-9713-46fa500121e2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:36.739356 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-524ea1a7-1a04-412c-9713-46fa500121e2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:36.748957 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-524ea1a7-1a04-412c-9713-46fa500121e2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1265 microversion: 2.1 time: 0.172013 Jan 24 22:36:36.748957 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 564/1111] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:36 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:36:37.457481 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-d9bd4ada-2644-4799-a9c3-b9f01e1debd9 req-a3bd6485-eeb7-4871-a4d3-a7d95148c2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "294678b9-e38b-4c90-8b10-52275ca06521", "tag": "1c993416-4d52-4b90-a42e-27e0ad5072cb"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:36:37.459087 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:36:37.459087 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:36:37.480755 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-d9bd4ada-2644-4799-a9c3-b9f01e1debd9 req-a3bd6485-eeb7-4871-a4d3-a7d95148c2f1 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:37.481278 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-d9bd4ada-2644-4799-a9c3-b9f01e1debd9 req-a3bd6485-eeb7-4871-a4d3-a7d95148c2f1 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:37.494398 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-d9bd4ada-2644-4799-a9c3-b9f01e1debd9 req-a3bd6485-eeb7-4871-a4d3-a7d95148c2f1 service nova] Creating event network-changed:1c993416-4d52-4b90-a42e-27e0ad5072cb for instance 294678b9-e38b-4c90-8b10-52275ca06521 on hv-cinder-81322 Jan 24 22:36:37.500020 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-d9bd4ada-2644-4799-a9c3-b9f01e1debd9 req-a3bd6485-eeb7-4871-a4d3-a7d95148c2f1 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050942 Jan 24 22:36:37.501483 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 548/1112] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:36:37.766641 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-04bf0a3a-96c1-4af6-8287-a04823f8f033 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:37.767255 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-04bf0a3a-96c1-4af6-8287-a04823f8f033 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:37.773993 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-04bf0a3a-96c1-4af6-8287-a04823f8f033 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:37.774482 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-04bf0a3a-96c1-4af6-8287-a04823f8f033 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:37.775262 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-04bf0a3a-96c1-4af6-8287-a04823f8f033 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:37.775692 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-04bf0a3a-96c1-4af6-8287-a04823f8f033 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:37.910424 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-04bf0a3a-96c1-4af6-8287-a04823f8f033 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:37.917833 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-04bf0a3a-96c1-4af6-8287-a04823f8f033 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1265 microversion: 2.1 time: 0.155539 Jan 24 22:36:37.918489 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 565/1113] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:37 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:38.940869 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-ef7484ef-9859-4e7c-b1c1-e18cc155ed73 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:38.942042 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-ef7484ef-9859-4e7c-b1c1-e18cc155ed73 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:38.952070 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ef7484ef-9859-4e7c-b1c1-e18cc155ed73 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:38.952523 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ef7484ef-9859-4e7c-b1c1-e18cc155ed73 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:38.953349 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ef7484ef-9859-4e7c-b1c1-e18cc155ed73 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:38.953784 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-ef7484ef-9859-4e7c-b1c1-e18cc155ed73 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:39.094472 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-ef7484ef-9859-4e7c-b1c1-e18cc155ed73 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:39.102363 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-ef7484ef-9859-4e7c-b1c1-e18cc155ed73 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1265 microversion: 2.1 time: 0.169496 Jan 24 22:36:39.102929 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 549/1114] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:38 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:40.123191 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-4d45f337-a74c-4960-8d73-4517c4428e8a tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:40.124906 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-4d45f337-a74c-4960-8d73-4517c4428e8a tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:40.131715 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4d45f337-a74c-4960-8d73-4517c4428e8a tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:40.132162 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4d45f337-a74c-4960-8d73-4517c4428e8a tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:40.133112 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4d45f337-a74c-4960-8d73-4517c4428e8a tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:40.133571 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-4d45f337-a74c-4960-8d73-4517c4428e8a tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:40.282834 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-4d45f337-a74c-4960-8d73-4517c4428e8a tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:40.294525 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-4d45f337-a74c-4960-8d73-4517c4428e8a tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1265 microversion: 2.1 time: 0.177664 Jan 24 22:36:40.295374 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 566/1115] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:40 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:41.315785 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a74b68fa-94c6-4ee4-bcd1-5aafe940918d tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:41.316723 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a74b68fa-94c6-4ee4-bcd1-5aafe940918d tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:41.326874 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a74b68fa-94c6-4ee4-bcd1-5aafe940918d tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:41.327290 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a74b68fa-94c6-4ee4-bcd1-5aafe940918d tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:41.328079 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a74b68fa-94c6-4ee4-bcd1-5aafe940918d tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:41.328504 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a74b68fa-94c6-4ee4-bcd1-5aafe940918d tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:41.471470 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a74b68fa-94c6-4ee4-bcd1-5aafe940918d tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:41.479763 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a74b68fa-94c6-4ee4-bcd1-5aafe940918d tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1265 microversion: 2.1 time: 0.170407 Jan 24 22:36:41.480331 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 550/1116] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:41 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:42.500781 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b798d04f-94db-42aa-b72e-910853b78cc9 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:42.501493 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b798d04f-94db-42aa-b72e-910853b78cc9 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:42.509145 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b798d04f-94db-42aa-b72e-910853b78cc9 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:42.509664 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b798d04f-94db-42aa-b72e-910853b78cc9 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:42.510626 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b798d04f-94db-42aa-b72e-910853b78cc9 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:42.511130 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b798d04f-94db-42aa-b72e-910853b78cc9 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:42.646370 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b798d04f-94db-42aa-b72e-910853b78cc9 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:42.654600 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b798d04f-94db-42aa-b72e-910853b78cc9 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1265 microversion: 2.1 time: 0.159744 Jan 24 22:36:42.655156 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 567/1117] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:42 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:43.676133 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e7e6d9ee-013a-4edc-ba09-7517b3717f70 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:43.677289 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e7e6d9ee-013a-4edc-ba09-7517b3717f70 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:43.687275 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e7e6d9ee-013a-4edc-ba09-7517b3717f70 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:43.687725 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e7e6d9ee-013a-4edc-ba09-7517b3717f70 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:43.688506 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e7e6d9ee-013a-4edc-ba09-7517b3717f70 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:43.688936 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e7e6d9ee-013a-4edc-ba09-7517b3717f70 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:43.835882 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e7e6d9ee-013a-4edc-ba09-7517b3717f70 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:43.843373 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e7e6d9ee-013a-4edc-ba09-7517b3717f70 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1265 microversion: 2.1 time: 0.174140 Jan 24 22:36:43.843927 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 551/1118] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:43 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:44.860269 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0ced3dc6-57e0-44a6-bb86-d12b0853fc0b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:44.860837 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0ced3dc6-57e0-44a6-bb86-d12b0853fc0b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:44.867818 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0ced3dc6-57e0-44a6-bb86-d12b0853fc0b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:44.868295 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0ced3dc6-57e0-44a6-bb86-d12b0853fc0b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:44.869152 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0ced3dc6-57e0-44a6-bb86-d12b0853fc0b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:44.869606 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0ced3dc6-57e0-44a6-bb86-d12b0853fc0b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:45.007000 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-0ced3dc6-57e0-44a6-bb86-d12b0853fc0b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:45.014984 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0ced3dc6-57e0-44a6-bb86-d12b0853fc0b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1265 microversion: 2.1 time: 0.158928 Jan 24 22:36:45.015556 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 568/1119] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:44 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:46.033044 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-bf4ac52b-7c8c-40db-9e23-b20c5e425829 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:46.033688 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-bf4ac52b-7c8c-40db-9e23-b20c5e425829 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:46.040345 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bf4ac52b-7c8c-40db-9e23-b20c5e425829 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:46.040791 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bf4ac52b-7c8c-40db-9e23-b20c5e425829 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:46.041621 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bf4ac52b-7c8c-40db-9e23-b20c5e425829 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:46.042247 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-bf4ac52b-7c8c-40db-9e23-b20c5e425829 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:46.184424 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-bf4ac52b-7c8c-40db-9e23-b20c5e425829 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:46.192440 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-bf4ac52b-7c8c-40db-9e23-b20c5e425829 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1265 microversion: 2.1 time: 0.163621 Jan 24 22:36:46.193009 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 552/1120] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:46 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:46.921002 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-e55ad859-f376-48e3-b0a0-cc41d8ccd8bc req-a4bb902a-7e18-46b8-8648-e6f628b010ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294678b9-e38b-4c90-8b10-52275ca06521", "name": "network-vif-plugged", "status": "completed", "tag": "1c993416-4d52-4b90-a42e-27e0ad5072cb"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:36:46.922574 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:36:46.922574 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:36:46.930069 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-e55ad859-f376-48e3-b0a0-cc41d8ccd8bc req-a4bb902a-7e18-46b8-8648-e6f628b010ea service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:46.930498 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-e55ad859-f376-48e3-b0a0-cc41d8ccd8bc req-a4bb902a-7e18-46b8-8648-e6f628b010ea service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:46.941906 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-e55ad859-f376-48e3-b0a0-cc41d8ccd8bc req-a4bb902a-7e18-46b8-8648-e6f628b010ea service nova] Creating event network-vif-plugged:1c993416-4d52-4b90-a42e-27e0ad5072cb for instance 294678b9-e38b-4c90-8b10-52275ca06521 on hv-cinder-81322 Jan 24 22:36:46.947043 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-e55ad859-f376-48e3-b0a0-cc41d8ccd8bc req-a4bb902a-7e18-46b8-8648-e6f628b010ea service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029903 Jan 24 22:36:46.947616 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 569/1121] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:36:47.214795 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-7ef1e6b0-2164-4e9a-abbd-5c0a0e8e55ad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:47.216104 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-7ef1e6b0-2164-4e9a-abbd-5c0a0e8e55ad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:47.223428 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7ef1e6b0-2164-4e9a-abbd-5c0a0e8e55ad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:47.223884 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7ef1e6b0-2164-4e9a-abbd-5c0a0e8e55ad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:47.224679 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7ef1e6b0-2164-4e9a-abbd-5c0a0e8e55ad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:47.225156 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-7ef1e6b0-2164-4e9a-abbd-5c0a0e8e55ad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:47.359240 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-7ef1e6b0-2164-4e9a-abbd-5c0a0e8e55ad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:47.367092 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-7ef1e6b0-2164-4e9a-abbd-5c0a0e8e55ad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1265 microversion: 2.1 time: 0.156103 Jan 24 22:36:47.367664 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 553/1122] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:47 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:48.386004 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-11d3ee94-02d5-48e4-90f7-dd00c132dc37 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:48.396538 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-11d3ee94-02d5-48e4-90f7-dd00c132dc37 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:48.396538 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-11d3ee94-02d5-48e4-90f7-dd00c132dc37 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:48.396911 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-11d3ee94-02d5-48e4-90f7-dd00c132dc37 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:48.397822 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-11d3ee94-02d5-48e4-90f7-dd00c132dc37 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:48.398251 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-11d3ee94-02d5-48e4-90f7-dd00c132dc37 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:48.540070 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-11d3ee94-02d5-48e4-90f7-dd00c132dc37 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:48.549347 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-11d3ee94-02d5-48e4-90f7-dd00c132dc37 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1451 microversion: 2.1 time: 0.168007 Jan 24 22:36:48.549929 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 570/1123] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:48 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:36:48.565977 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-818cec76-f9a4-41a7-9ea9-84ba41e1676c tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:36:48.566595 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-818cec76-f9a4-41a7-9ea9-84ba41e1676c tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:36:48.573018 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-818cec76-f9a4-41a7-9ea9-84ba41e1676c tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:48.573487 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-818cec76-f9a4-41a7-9ea9-84ba41e1676c tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:48.574248 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-818cec76-f9a4-41a7-9ea9-84ba41e1676c tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:48.574678 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-818cec76-f9a4-41a7-9ea9-84ba41e1676c tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:48.703359 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-818cec76-f9a4-41a7-9ea9-84ba41e1676c tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:36:48.711573 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-818cec76-f9a4-41a7-9ea9-84ba41e1676c tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1451 microversion: 2.1 time: 0.149340 Jan 24 22:36:48.712137 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 554/1124] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:36:48 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:36:50.502977 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-4eccb153-088e-439c-9a8b-55c63be98b3a req-27c50adb-60c5-455a-95c4-9dbf50f6d56d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "294678b9-e38b-4c90-8b10-52275ca06521", "tag": "1c993416-4d52-4b90-a42e-27e0ad5072cb"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:36:50.504489 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:36:50.504489 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:36:50.511715 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-4eccb153-088e-439c-9a8b-55c63be98b3a req-27c50adb-60c5-455a-95c4-9dbf50f6d56d service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:36:50.512154 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-4eccb153-088e-439c-9a8b-55c63be98b3a req-27c50adb-60c5-455a-95c4-9dbf50f6d56d service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:36:50.523867 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-4eccb153-088e-439c-9a8b-55c63be98b3a req-27c50adb-60c5-455a-95c4-9dbf50f6d56d service nova] Creating event network-changed:1c993416-4d52-4b90-a42e-27e0ad5072cb for instance 294678b9-e38b-4c90-8b10-52275ca06521 on hv-cinder-81322 Jan 24 22:36:50.528913 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-4eccb153-088e-439c-9a8b-55c63be98b3a req-27c50adb-60c5-455a-95c4-9dbf50f6d56d service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030308 Jan 24 22:36:50.529943 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 571/1125] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:37:30.117443 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e3cbe8bd-a29d-4384-993c-e0bbb3df2e8f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:37:30.118259 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e3cbe8bd-a29d-4384-993c-e0bbb3df2e8f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:37:30.120342 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-defb842a-322d-42e3-bcdb-17b5b70f2a81 req-d5feaa91-99bf-45aa-bd70-a4dc2b8693d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1d2298-3059-437a-9f1a-6173d40e21ca", "tag": "4b3048ce-5caa-49ca-82eb-b694366739aa"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:37:30.121933 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:37:30.121933 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:37:30.124427 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3cbe8bd-a29d-4384-993c-e0bbb3df2e8f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:37:30.124869 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3cbe8bd-a29d-4384-993c-e0bbb3df2e8f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:37:30.126083 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3cbe8bd-a29d-4384-993c-e0bbb3df2e8f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:37:30.126202 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3cbe8bd-a29d-4384-993c-e0bbb3df2e8f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:37:30.129935 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-defb842a-322d-42e3-bcdb-17b5b70f2a81 req-d5feaa91-99bf-45aa-bd70-a4dc2b8693d5 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:37:30.130443 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-defb842a-322d-42e3-bcdb-17b5b70f2a81 req-d5feaa91-99bf-45aa-bd70-a4dc2b8693d5 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:37:30.141615 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-defb842a-322d-42e3-bcdb-17b5b70f2a81 req-d5feaa91-99bf-45aa-bd70-a4dc2b8693d5 service nova] Creating event network-changed:4b3048ce-5caa-49ca-82eb-b694366739aa for instance ab1d2298-3059-437a-9f1a-6173d40e21ca on hv-cinder-81322 Jan 24 22:37:30.147006 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-defb842a-322d-42e3-bcdb-17b5b70f2a81 req-d5feaa91-99bf-45aa-bd70-a4dc2b8693d5 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031254 Jan 24 22:37:30.148101 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 572/1126] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:37:30.152239 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e3cbe8bd-a29d-4384-993c-e0bbb3df2e8f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Going to try to terminate instance {{(pid=116466) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:37:30.247495 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e3cbe8bd-a29d-4384-993c-e0bbb3df2e8f tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "DELETE /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 204 len: 0 microversion: 2.1 time: 0.133859 Jan 24 22:37:30.248084 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 555/1127] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:37:30 2022] DELETE /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:37:30.257293 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-1364bd45-d5a4-4ad6-945e-dc163435b6e4 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:37:30.257990 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-1364bd45-d5a4-4ad6-945e-dc163435b6e4 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:37:30.264307 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1364bd45-d5a4-4ad6-945e-dc163435b6e4 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:37:30.264750 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1364bd45-d5a4-4ad6-945e-dc163435b6e4 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:37:30.266244 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1364bd45-d5a4-4ad6-945e-dc163435b6e4 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:37:30.266244 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-1364bd45-d5a4-4ad6-945e-dc163435b6e4 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:37:30.418042 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-1364bd45-d5a4-4ad6-945e-dc163435b6e4 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:37:30.425616 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-1364bd45-d5a4-4ad6-945e-dc163435b6e4 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1569 microversion: 2.1 time: 0.172482 Jan 24 22:37:30.426159 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 573/1128] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:37:30 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:37:31.447573 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e29215a7-7f6a-41af-9922-bdc4a708109b tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:37:31.448388 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e29215a7-7f6a-41af-9922-bdc4a708109b tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:37:31.456189 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e29215a7-7f6a-41af-9922-bdc4a708109b tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:37:31.456719 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e29215a7-7f6a-41af-9922-bdc4a708109b tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:37:31.457695 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e29215a7-7f6a-41af-9922-bdc4a708109b tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:37:31.458204 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e29215a7-7f6a-41af-9922-bdc4a708109b tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:37:31.599630 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e29215a7-7f6a-41af-9922-bdc4a708109b tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:37:31.608131 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e29215a7-7f6a-41af-9922-bdc4a708109b tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1450 microversion: 2.1 time: 0.166936 Jan 24 22:37:31.608704 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 556/1129] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:37:31 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1450 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:37:32.408331 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-f92549e8-aa5f-415b-8356-fa845aa8ddee req-72dd923b-14e8-4411-ba39-bb87a7a957c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1d2298-3059-437a-9f1a-6173d40e21ca", "name": "network-vif-deleted", "tag": "4b3048ce-5caa-49ca-82eb-b694366739aa"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:37:32.409875 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:37:32.409875 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:37:32.418199 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-f92549e8-aa5f-415b-8356-fa845aa8ddee req-72dd923b-14e8-4411-ba39-bb87a7a957c2 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:37:32.418650 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-f92549e8-aa5f-415b-8356-fa845aa8ddee req-72dd923b-14e8-4411-ba39-bb87a7a957c2 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:37:32.429811 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-f92549e8-aa5f-415b-8356-fa845aa8ddee req-72dd923b-14e8-4411-ba39-bb87a7a957c2 service nova] Creating event network-vif-deleted:4b3048ce-5caa-49ca-82eb-b694366739aa for instance ab1d2298-3059-437a-9f1a-6173d40e21ca on hv-cinder-81322 Jan 24 22:37:32.435073 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-f92549e8-aa5f-415b-8356-fa845aa8ddee req-72dd923b-14e8-4411-ba39-bb87a7a957c2 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030385 Jan 24 22:37:32.435689 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 574/1130] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:37:32.630526 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e3ab78d4-aaf5-44f1-8a25-5072e6bb1f97 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:37:32.631424 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e3ab78d4-aaf5-44f1-8a25-5072e6bb1f97 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:37:32.642057 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3ab78d4-aaf5-44f1-8a25-5072e6bb1f97 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:37:32.642795 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3ab78d4-aaf5-44f1-8a25-5072e6bb1f97 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:37:32.644075 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3ab78d4-aaf5-44f1-8a25-5072e6bb1f97 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:37:32.644790 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3ab78d4-aaf5-44f1-8a25-5072e6bb1f97 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:37:32.715398 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e3ab78d4-aaf5-44f1-8a25-5072e6bb1f97 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ef8bba622344a4bdb1b08532943f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63897275a7664529bc1d568ba2f36b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:37:32.735069 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e3ab78d4-aaf5-44f1-8a25-5072e6bb1f97 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 200 len: 1219 microversion: 2.1 time: 0.110885 Jan 24 22:37:32.735647 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 557/1131] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:37:32 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:37:33.760831 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-99253acb-fd44-4f4b-9d97-90b57f7c6c8e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:37:33.761511 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-99253acb-fd44-4f4b-9d97-90b57f7c6c8e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] [instance: ab1d2298-3059-437a-9f1a-6173d40e21ca] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:37:33.768305 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-99253acb-fd44-4f4b-9d97-90b57f7c6c8e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:37:33.768754 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-99253acb-fd44-4f4b-9d97-90b57f7c6c8e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:37:33.769566 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-99253acb-fd44-4f4b-9d97-90b57f7c6c8e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:37:33.769998 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-99253acb-fd44-4f4b-9d97-90b57f7c6c8e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:37:33.785159 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-99253acb-fd44-4f4b-9d97-90b57f7c6c8e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] HTTP exception thrown: Instance ab1d2298-3059-437a-9f1a-6173d40e21ca could not be found. Jan 24 22:37:33.785756 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-99253acb-fd44-4f4b-9d97-90b57f7c6c8e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Returning 404 to user: Instance ab1d2298-3059-437a-9f1a-6173d40e21ca could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:37:33.786586 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-99253acb-fd44-4f4b-9d97-90b57f7c6c8e tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca" status: 404 len: 111 microversion: 2.1 time: 0.034820 Jan 24 22:37:33.787135 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 575/1132] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:37:33 2022] GET /compute/v2.1/servers/ab1d2298-3059-437a-9f1a-6173d40e21ca => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:37:33.963235 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-6739593d-9ec0-4a51-ad34-111afa3e7709 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] Calling method '.version_select at 0x7f7e5d167430>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:37:33.987594 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-6739593d-9ec0-4a51-ad34-111afa3e7709 tempest-TestShelveInstance-890482763 tempest-TestShelveInstance-890482763-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-829940236" status: 202 len: 0 microversion: 2.1 time: 0.028623 Jan 24 22:37:33.988163 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 558/1133] 10.222.0.84 () {58 vars in 1250 bytes} [Mon Jan 24 22:37:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-829940236 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:38:42.704506 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8664c395-e55d-4059-a59a-36d25c06176f] AMQP server on 10.222.0.84:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 24 22:38:42.708193 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-ccaf9829-e238-475a-b6bb-d58ae8f94eee tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:38:42.708657 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ccaf9829-e238-475a-b6bb-d58ae8f94eee tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:38:42.715152 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ccaf9829-e238-475a-b6bb-d58ae8f94eee tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:42.715604 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ccaf9829-e238-475a-b6bb-d58ae8f94eee tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:42.716377 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ccaf9829-e238-475a-b6bb-d58ae8f94eee tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:42.716812 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-ccaf9829-e238-475a-b6bb-d58ae8f94eee tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:42.741869 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-ccaf9829-e238-475a-b6bb-d58ae8f94eee tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Going to try to terminate instance {{(pid=116467) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:38:42.829262 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-ccaf9829-e238-475a-b6bb-d58ae8f94eee tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "DELETE /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 204 len: 0 microversion: 2.1 time: 0.126655 Jan 24 22:38:42.829969 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 576/1134] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:38:42 2022] DELETE /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:38:42.837454 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8853d630-bc08-479a-b0d7-f331feccc39c] AMQP server on 10.222.0.84:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 24 22:38:42.841608 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-5aa86fbc-b97b-413c-af0c-78380d295529 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:38:42.842356 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-5aa86fbc-b97b-413c-af0c-78380d295529 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:38:42.848309 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5aa86fbc-b97b-413c-af0c-78380d295529 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:42.848921 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5aa86fbc-b97b-413c-af0c-78380d295529 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:42.849634 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5aa86fbc-b97b-413c-af0c-78380d295529 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:42.850069 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-5aa86fbc-b97b-413c-af0c-78380d295529 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:43.203202 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-5aa86fbc-b97b-413c-af0c-78380d295529 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:38:43.215686 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-5aa86fbc-b97b-413c-af0c-78380d295529 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1576 microversion: 2.1 time: 0.380022 Jan 24 22:38:43.216444 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 559/1135] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:38:42 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1576 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:38:44.238516 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6f567c39-0776-4838-8f29-831f938e9d56 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:38:44.240010 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-6f567c39-0776-4838-8f29-831f938e9d56 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:38:44.249223 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6f567c39-0776-4838-8f29-831f938e9d56 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:44.249666 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6f567c39-0776-4838-8f29-831f938e9d56 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:44.250439 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6f567c39-0776-4838-8f29-831f938e9d56 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:44.250865 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-6f567c39-0776-4838-8f29-831f938e9d56 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:44.256049 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO oslo.messaging._drivers.impl_rabbit [-] [8664c395-e55d-4059-a59a-36d25c06176f] Reconnected to AMQP server on 10.222.0.84:5672 via [amqp] client with port 60208. Jan 24 22:38:44.459149 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-6f567c39-0776-4838-8f29-831f938e9d56 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:38:44.467159 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6f567c39-0776-4838-8f29-831f938e9d56 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1576 microversion: 2.1 time: 0.235346 Jan 24 22:38:44.467730 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 577/1136] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:38:44 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1576 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:38:45.485041 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b76f0fac-0bd5-4a9f-876c-98c2e516bb3f tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:38:45.485660 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b76f0fac-0bd5-4a9f-876c-98c2e516bb3f tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:38:45.493400 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b76f0fac-0bd5-4a9f-876c-98c2e516bb3f tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:45.493841 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b76f0fac-0bd5-4a9f-876c-98c2e516bb3f tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:45.494620 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b76f0fac-0bd5-4a9f-876c-98c2e516bb3f tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:45.495041 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-b76f0fac-0bd5-4a9f-876c-98c2e516bb3f tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:45.511210 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO oslo.messaging._drivers.impl_rabbit [-] [8853d630-bc08-479a-b0d7-f331feccc39c] Reconnected to AMQP server on 10.222.0.84:5672 via [amqp] client with port 60214. Jan 24 22:38:45.562017 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b76f0fac-0bd5-4a9f-876c-98c2e516bb3f tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:38:45.571114 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b76f0fac-0bd5-4a9f-876c-98c2e516bb3f tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 200 len: 1510 microversion: 2.1 time: 0.089801 Jan 24 22:38:45.572231 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 560/1137] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:38:45 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 1510 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:38:45.648151 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-9c0cd3bb-d27e-4ea7-9e2a-d50eee52f63c req-81c80aba-564a-49d2-9ba9-3b4d7f3ff414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294678b9-e38b-4c90-8b10-52275ca06521", "name": "network-vif-deleted", "tag": "1c993416-4d52-4b90-a42e-27e0ad5072cb"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:38:45.649304 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:38:45.649304 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:38:45.657330 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-9c0cd3bb-d27e-4ea7-9e2a-d50eee52f63c req-81c80aba-564a-49d2-9ba9-3b4d7f3ff414 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:45.657768 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-9c0cd3bb-d27e-4ea7-9e2a-d50eee52f63c req-81c80aba-564a-49d2-9ba9-3b4d7f3ff414 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:45.674625 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-9c0cd3bb-d27e-4ea7-9e2a-d50eee52f63c req-81c80aba-564a-49d2-9ba9-3b4d7f3ff414 service nova] Creating event network-vif-deleted:1c993416-4d52-4b90-a42e-27e0ad5072cb for instance 294678b9-e38b-4c90-8b10-52275ca06521 on hv-cinder-81322 Jan 24 22:38:45.681454 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-9c0cd3bb-d27e-4ea7-9e2a-d50eee52f63c req-81c80aba-564a-49d2-9ba9-3b4d7f3ff414 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109370 Jan 24 22:38:45.682055 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 578/1138] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:38:46.588107 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-27152081-340c-405a-a889-dc93fc085f07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:38:46.588706 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-27152081-340c-405a-a889-dc93fc085f07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:38:46.595687 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-27152081-340c-405a-a889-dc93fc085f07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:46.596138 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-27152081-340c-405a-a889-dc93fc085f07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:46.596904 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-27152081-340c-405a-a889-dc93fc085f07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:46.597368 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-27152081-340c-405a-a889-dc93fc085f07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:46.612347 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-27152081-340c-405a-a889-dc93fc085f07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] HTTP exception thrown: Instance 294678b9-e38b-4c90-8b10-52275ca06521 could not be found. Jan 24 22:38:46.613132 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-27152081-340c-405a-a889-dc93fc085f07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Returning 404 to user: Instance 294678b9-e38b-4c90-8b10-52275ca06521 could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:38:46.614255 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-27152081-340c-405a-a889-dc93fc085f07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 404 len: 111 microversion: 2.1 time: 0.030089 Jan 24 22:38:46.614847 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 561/1139] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:38:46 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:38:46.717432 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0db2b647-c6f9-4982-b054-4d8be21ec346 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1476925963", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1514835326", "security_groups": [{"name": "tempest-secgroup-smoke-11730502"}], "block_device_mapping_v2": [{"uuid": "f11232f6-77ce-42bd-89a9-c5ca538f7b87", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "04a2e7fe-f97a-4f14-b8ec-d5987baf93bb"}]}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:38:46.832810 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.network.neutron [None req-0db2b647-c6f9-4982-b054-4d8be21ec346 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] validate_networks() for [('04a2e7fe-f97a-4f14-b8ec-d5987baf93bb', None, None, None, None, None)] {{(pid=116467) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:38:47.292259 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-0db2b647-c6f9-4982-b054-4d8be21ec346 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Flavor limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:38:47.292780 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-0db2b647-c6f9-4982-b054-4d8be21ec346 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Image limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:38:47.293472 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-0db2b647-c6f9-4982-b054-4d8be21ec346 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Flavor pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:38:47.294067 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-0db2b647-c6f9-4982-b054-4d8be21ec346 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Image pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:38:47.294671 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-0db2b647-c6f9-4982-b054-4d8be21ec346 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:38:47.307615 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0db2b647-c6f9-4982-b054-4d8be21ec346 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:47.308061 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0db2b647-c6f9-4982-b054-4d8be21ec346 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:47.308871 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0db2b647-c6f9-4982-b054-4d8be21ec346 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:47.309337 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0db2b647-c6f9-4982-b054-4d8be21ec346 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:47.327037 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-0db2b647-c6f9-4982-b054-4d8be21ec346 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Getting quotas for project 3e579d6f341241508dfd3800965f27c1. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:38:47.331461 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-0db2b647-c6f9-4982-b054-4d8be21ec346 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Getting quotas for user 6b9bf7472d3843efbcade92387a0ee09 and project 3e579d6f341241508dfd3800965f27c1. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:38:47.400043 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0db2b647-c6f9-4982-b054-4d8be21ec346 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Going to run 1 instances... {{(pid=116467) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:38:47.402328 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0db2b647-c6f9-4982-b054-4d8be21ec346 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f11232f6-77ce-42bd-89a9-c5ca538f7b87',volume_size=None,volume_type=None)] {{(pid=116467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:38:47.544873 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0db2b647-c6f9-4982-b054-4d8be21ec346 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.831869 Jan 24 22:38:47.545763 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 579/1140] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:38:46 2022] POST /compute/v2.1/servers => generated 404 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 24 22:38:47.555614 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-3b71e0e6-cbd8-44ca-8fd0-b363a6da220b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:38:47.556234 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-3b71e0e6-cbd8-44ca-8fd0-b363a6da220b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:38:47.606528 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-3b71e0e6-cbd8-44ca-8fd0-b363a6da220b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:38:47.614180 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-3b71e0e6-cbd8-44ca-8fd0-b363a6da220b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1095 microversion: 2.1 time: 0.062182 Jan 24 22:38:47.614715 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 562/1141] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:38:47 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1095 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:38:48.631865 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-3581b5a1-28e5-4448-8715-9e1fbc0537ea tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:38:48.632537 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-3581b5a1-28e5-4448-8715-9e1fbc0537ea tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:38:48.640179 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3581b5a1-28e5-4448-8715-9e1fbc0537ea tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:48.640625 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3581b5a1-28e5-4448-8715-9e1fbc0537ea tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:48.641458 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3581b5a1-28e5-4448-8715-9e1fbc0537ea tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:48.641927 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-3581b5a1-28e5-4448-8715-9e1fbc0537ea tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:48.702622 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-3581b5a1-28e5-4448-8715-9e1fbc0537ea tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:38:48.710811 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-3581b5a1-28e5-4448-8715-9e1fbc0537ea tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1201 microversion: 2.1 time: 0.082887 Jan 24 22:38:48.711575 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 580/1142] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:38:48 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1201 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:38:49.728835 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-34c506bd-9108-4c9f-9309-75b15f1d9522 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:38:49.729500 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-34c506bd-9108-4c9f-9309-75b15f1d9522 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:38:49.736069 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-34c506bd-9108-4c9f-9309-75b15f1d9522 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:49.736528 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-34c506bd-9108-4c9f-9309-75b15f1d9522 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:49.737349 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-34c506bd-9108-4c9f-9309-75b15f1d9522 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:49.737784 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-34c506bd-9108-4c9f-9309-75b15f1d9522 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:49.882456 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-34c506bd-9108-4c9f-9309-75b15f1d9522 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:38:49.891623 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-34c506bd-9108-4c9f-9309-75b15f1d9522 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1265 microversion: 2.1 time: 0.167361 Jan 24 22:38:49.892823 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 563/1143] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:38:49 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:38:50.104345 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-38ea72aa-6259-4ff2-bb3f-1f16bb132896 req-41a10cda-b313-4199-b204-d25e65139753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b47787b-bc59-4796-a933-33b728d46c06", "tag": "2f024c9b-bf4d-42cc-9e19-4a9be6c5b36f"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:38:50.106104 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:38:50.106104 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:38:50.117743 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-38ea72aa-6259-4ff2-bb3f-1f16bb132896 req-41a10cda-b313-4199-b204-d25e65139753 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:50.118675 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-38ea72aa-6259-4ff2-bb3f-1f16bb132896 req-41a10cda-b313-4199-b204-d25e65139753 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:50.130990 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-38ea72aa-6259-4ff2-bb3f-1f16bb132896 req-41a10cda-b313-4199-b204-d25e65139753 service nova] Creating event network-changed:2f024c9b-bf4d-42cc-9e19-4a9be6c5b36f for instance 3b47787b-bc59-4796-a933-33b728d46c06 on hv-cinder-81322 Jan 24 22:38:50.136605 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-38ea72aa-6259-4ff2-bb3f-1f16bb132896 req-41a10cda-b313-4199-b204-d25e65139753 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036061 Jan 24 22:38:50.137927 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 581/1144] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 22:38:50.909094 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-a30fb024-fdc3-459c-a044-1d51ad3bec18 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:38:50.909693 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-a30fb024-fdc3-459c-a044-1d51ad3bec18 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:38:50.916668 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a30fb024-fdc3-459c-a044-1d51ad3bec18 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:50.917155 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a30fb024-fdc3-459c-a044-1d51ad3bec18 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:50.917943 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a30fb024-fdc3-459c-a044-1d51ad3bec18 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:50.918374 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-a30fb024-fdc3-459c-a044-1d51ad3bec18 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:51.068358 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-a30fb024-fdc3-459c-a044-1d51ad3bec18 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:38:51.076171 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-a30fb024-fdc3-459c-a044-1d51ad3bec18 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1265 microversion: 2.1 time: 0.170872 Jan 24 22:38:51.076828 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 564/1145] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:38:50 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:38:52.096132 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2e1f8bf8-bda7-4c8d-bfc0-f0253c2de7e2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:38:52.096955 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2e1f8bf8-bda7-4c8d-bfc0-f0253c2de7e2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:38:52.104478 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2e1f8bf8-bda7-4c8d-bfc0-f0253c2de7e2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:52.104909 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2e1f8bf8-bda7-4c8d-bfc0-f0253c2de7e2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:52.105714 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2e1f8bf8-bda7-4c8d-bfc0-f0253c2de7e2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:52.106135 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2e1f8bf8-bda7-4c8d-bfc0-f0253c2de7e2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:52.248967 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2e1f8bf8-bda7-4c8d-bfc0-f0253c2de7e2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:38:52.257163 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2e1f8bf8-bda7-4c8d-bfc0-f0253c2de7e2 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1265 microversion: 2.1 time: 0.166645 Jan 24 22:38:52.257864 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 582/1146] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:38:52 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:38:53.277035 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-e3e9b053-5cad-4ab8-b82b-b452a3c9d54f tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:38:53.277676 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-e3e9b053-5cad-4ab8-b82b-b452a3c9d54f tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:38:53.284690 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3e9b053-5cad-4ab8-b82b-b452a3c9d54f tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:53.285180 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3e9b053-5cad-4ab8-b82b-b452a3c9d54f tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:53.285959 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3e9b053-5cad-4ab8-b82b-b452a3c9d54f tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:53.286397 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-e3e9b053-5cad-4ab8-b82b-b452a3c9d54f tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:53.430290 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-e3e9b053-5cad-4ab8-b82b-b452a3c9d54f tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:38:53.438550 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-e3e9b053-5cad-4ab8-b82b-b452a3c9d54f tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1265 microversion: 2.1 time: 0.165911 Jan 24 22:38:53.439122 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 565/1147] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:38:53 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:38:54.459086 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-db60e3db-a885-4d95-9416-42d8a81409ec tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:38:54.460133 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-db60e3db-a885-4d95-9416-42d8a81409ec tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:38:54.470723 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-db60e3db-a885-4d95-9416-42d8a81409ec tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:54.471413 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-db60e3db-a885-4d95-9416-42d8a81409ec tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:54.472710 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-db60e3db-a885-4d95-9416-42d8a81409ec tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:54.473471 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-db60e3db-a885-4d95-9416-42d8a81409ec tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:54.628408 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-db60e3db-a885-4d95-9416-42d8a81409ec tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:38:54.636403 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-db60e3db-a885-4d95-9416-42d8a81409ec tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1265 microversion: 2.1 time: 0.183618 Jan 24 22:38:54.636963 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 583/1148] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:38:54 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:38:55.657140 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c12375e9-87fa-4326-949c-b06ad9c57994 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:38:55.658078 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c12375e9-87fa-4326-949c-b06ad9c57994 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:38:55.669403 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c12375e9-87fa-4326-949c-b06ad9c57994 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:55.670145 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c12375e9-87fa-4326-949c-b06ad9c57994 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:55.671420 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c12375e9-87fa-4326-949c-b06ad9c57994 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:55.672135 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c12375e9-87fa-4326-949c-b06ad9c57994 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:55.831825 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c12375e9-87fa-4326-949c-b06ad9c57994 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:38:55.839667 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c12375e9-87fa-4326-949c-b06ad9c57994 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1265 microversion: 2.1 time: 0.188867 Jan 24 22:38:55.840235 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 566/1149] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:38:55 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:38:56.859848 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-14aa1f38-56f8-4e64-86ee-90d148b2e7cb tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:38:56.860807 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-14aa1f38-56f8-4e64-86ee-90d148b2e7cb tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:38:56.870281 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-14aa1f38-56f8-4e64-86ee-90d148b2e7cb tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:56.870721 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-14aa1f38-56f8-4e64-86ee-90d148b2e7cb tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:56.871825 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-14aa1f38-56f8-4e64-86ee-90d148b2e7cb tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:56.872263 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-14aa1f38-56f8-4e64-86ee-90d148b2e7cb tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:57.016736 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-14aa1f38-56f8-4e64-86ee-90d148b2e7cb tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:38:57.027022 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-14aa1f38-56f8-4e64-86ee-90d148b2e7cb tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1265 microversion: 2.1 time: 0.173459 Jan 24 22:38:57.027588 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 584/1150] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:38:56 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:38:58.052532 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-c31de46b-c049-4f67-8119-2f3b6d737d1d tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:38:58.053566 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-c31de46b-c049-4f67-8119-2f3b6d737d1d tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:38:58.064375 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c31de46b-c049-4f67-8119-2f3b6d737d1d tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:58.065161 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c31de46b-c049-4f67-8119-2f3b6d737d1d tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:58.066428 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c31de46b-c049-4f67-8119-2f3b6d737d1d tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:58.067142 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-c31de46b-c049-4f67-8119-2f3b6d737d1d tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:58.209263 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-c31de46b-c049-4f67-8119-2f3b6d737d1d tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:38:58.217202 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-c31de46b-c049-4f67-8119-2f3b6d737d1d tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1265 microversion: 2.1 time: 0.170755 Jan 24 22:38:58.217772 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 567/1151] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:38:58 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:38:59.238301 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-29e7744d-7796-497d-9a6d-1680e4b88c9e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:38:59.239165 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-29e7744d-7796-497d-9a6d-1680e4b88c9e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:38:59.248433 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-29e7744d-7796-497d-9a6d-1680e4b88c9e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:59.248881 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-29e7744d-7796-497d-9a6d-1680e4b88c9e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:59.249698 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-29e7744d-7796-497d-9a6d-1680e4b88c9e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:59.250134 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-29e7744d-7796-497d-9a6d-1680e4b88c9e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:59.399820 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-29e7744d-7796-497d-9a6d-1680e4b88c9e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:38:59.408539 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-29e7744d-7796-497d-9a6d-1680e4b88c9e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1265 microversion: 2.1 time: 0.176558 Jan 24 22:38:59.418226 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 585/1152] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:38:59 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:38:59.534106 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-f30cf9cc-5c77-4ce5-bc73-b93d56bf2535 req-5d1e82d1-a9a0-40ae-9251-e67532301a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b47787b-bc59-4796-a933-33b728d46c06", "name": "network-vif-plugged", "status": "completed", "tag": "2f024c9b-bf4d-42cc-9e19-4a9be6c5b36f"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:38:59.535677 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:38:59.535677 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:38:59.543554 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-f30cf9cc-5c77-4ce5-bc73-b93d56bf2535 req-5d1e82d1-a9a0-40ae-9251-e67532301a13 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:38:59.543988 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-f30cf9cc-5c77-4ce5-bc73-b93d56bf2535 req-5d1e82d1-a9a0-40ae-9251-e67532301a13 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:38:59.554938 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-f30cf9cc-5c77-4ce5-bc73-b93d56bf2535 req-5d1e82d1-a9a0-40ae-9251-e67532301a13 service nova] Creating event network-vif-plugged:2f024c9b-bf4d-42cc-9e19-4a9be6c5b36f for instance 3b47787b-bc59-4796-a933-33b728d46c06 on hv-cinder-81322 Jan 24 22:38:59.561004 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-f30cf9cc-5c77-4ce5-bc73-b93d56bf2535 req-5d1e82d1-a9a0-40ae-9251-e67532301a13 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089485 Jan 24 22:38:59.561970 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 568/1153] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:39:00.428979 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-fad10c0e-f53e-4a7f-a81e-384493932b07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:39:00.430040 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-fad10c0e-f53e-4a7f-a81e-384493932b07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:39:00.440753 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fad10c0e-f53e-4a7f-a81e-384493932b07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:39:00.441555 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fad10c0e-f53e-4a7f-a81e-384493932b07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:39:00.442835 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fad10c0e-f53e-4a7f-a81e-384493932b07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:39:00.443561 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-fad10c0e-f53e-4a7f-a81e-384493932b07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:39:00.581503 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-fad10c0e-f53e-4a7f-a81e-384493932b07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:39:00.589605 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-fad10c0e-f53e-4a7f-a81e-384493932b07 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1265 microversion: 2.1 time: 0.166744 Jan 24 22:39:00.590184 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 586/1154] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:39:00 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:39:01.609095 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1053bb41-b33c-4d4a-9216-b28bc96cc7e4 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:39:01.609785 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-1053bb41-b33c-4d4a-9216-b28bc96cc7e4 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:39:01.620870 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1053bb41-b33c-4d4a-9216-b28bc96cc7e4 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:39:01.621361 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1053bb41-b33c-4d4a-9216-b28bc96cc7e4 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:39:01.622485 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1053bb41-b33c-4d4a-9216-b28bc96cc7e4 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:39:01.622919 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1053bb41-b33c-4d4a-9216-b28bc96cc7e4 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:39:01.767372 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-1053bb41-b33c-4d4a-9216-b28bc96cc7e4 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:39:01.778751 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-1053bb41-b33c-4d4a-9216-b28bc96cc7e4 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1451 microversion: 2.1 time: 0.174526 Jan 24 22:39:01.779595 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 569/1155] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:39:01 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:39:01.800232 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-b4c28f88-ca24-4e51-bacb-84543465cea3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:39:01.800869 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-b4c28f88-ca24-4e51-bacb-84543465cea3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:39:01.808036 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b4c28f88-ca24-4e51-bacb-84543465cea3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:39:01.808744 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b4c28f88-ca24-4e51-bacb-84543465cea3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:39:01.809573 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b4c28f88-ca24-4e51-bacb-84543465cea3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:39:01.810014 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-b4c28f88-ca24-4e51-bacb-84543465cea3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:39:01.955214 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-b4c28f88-ca24-4e51-bacb-84543465cea3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:39:01.963239 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-b4c28f88-ca24-4e51-bacb-84543465cea3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1451 microversion: 2.1 time: 0.166730 Jan 24 22:39:01.963822 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 587/1156] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:39:01 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:39:03.957940 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-033248f1-6f97-4574-aa5f-1b55345425cb req-ae690b20-7a89-49da-a6cf-2ee911dd3c90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b47787b-bc59-4796-a933-33b728d46c06", "tag": "2f024c9b-bf4d-42cc-9e19-4a9be6c5b36f"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:39:03.959466 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:39:03.959466 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:39:03.966408 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-033248f1-6f97-4574-aa5f-1b55345425cb req-ae690b20-7a89-49da-a6cf-2ee911dd3c90 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:39:03.966847 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-033248f1-6f97-4574-aa5f-1b55345425cb req-ae690b20-7a89-49da-a6cf-2ee911dd3c90 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:39:03.978629 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-033248f1-6f97-4574-aa5f-1b55345425cb req-ae690b20-7a89-49da-a6cf-2ee911dd3c90 service nova] Creating event network-changed:2f024c9b-bf4d-42cc-9e19-4a9be6c5b36f for instance 3b47787b-bc59-4796-a933-33b728d46c06 on hv-cinder-81322 Jan 24 22:39:03.983713 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-033248f1-6f97-4574-aa5f-1b55345425cb req-ae690b20-7a89-49da-a6cf-2ee911dd3c90 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089750 Jan 24 22:39:03.984373 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 570/1157] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:39:29.494882 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 22:39:29.496046 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: Mon Jan 24 22:39:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 22:40:41.157414 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-eecb443e-daea-480a-8ff0-c09a8530acad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2034760912", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1514835326", "security_groups": [{"name": "tempest-secgroup-smoke-11730502"}], "block_device_mapping_v2": [{"uuid": "50a468b2-dc9a-461d-a2bb-5251bcfd9cf2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "04a2e7fe-f97a-4f14-b8ec-d5987baf93bb"}]}} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:40:41.266525 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.network.neutron [None req-eecb443e-daea-480a-8ff0-c09a8530acad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] validate_networks() for [('04a2e7fe-f97a-4f14-b8ec-d5987baf93bb', None, None, None, None, None)] {{(pid=116467) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 22:40:41.648857 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-eecb443e-daea-480a-8ff0-c09a8530acad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Flavor limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 22:40:41.649317 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-eecb443e-daea-480a-8ff0-c09a8530acad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Image limits 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 22:40:41.650085 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-eecb443e-daea-480a-8ff0-c09a8530acad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Flavor pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 22:40:41.650612 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-eecb443e-daea-480a-8ff0-c09a8530acad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Image pref 0:0:0 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 22:40:41.651026 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.virt.hardware [None req-eecb443e-daea-480a-8ff0-c09a8530acad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116467) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 22:40:41.660912 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-eecb443e-daea-480a-8ff0-c09a8530acad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:41.661392 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-eecb443e-daea-480a-8ff0-c09a8530acad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:41.662192 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-eecb443e-daea-480a-8ff0-c09a8530acad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:41.662624 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-eecb443e-daea-480a-8ff0-c09a8530acad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:41.679451 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-eecb443e-daea-480a-8ff0-c09a8530acad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Getting quotas for project 3e579d6f341241508dfd3800965f27c1. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 22:40:41.683871 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.quota [None req-eecb443e-daea-480a-8ff0-c09a8530acad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Getting quotas for user 6b9bf7472d3843efbcade92387a0ee09 and project 3e579d6f341241508dfd3800965f27c1. Resources: {'cores', 'instances', 'ram'} {{(pid=116467) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 22:40:41.742709 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-eecb443e-daea-480a-8ff0-c09a8530acad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Going to run 1 instances... {{(pid=116467) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 22:40:41.745499 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-eecb443e-daea-480a-8ff0-c09a8530acad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='50a468b2-dc9a-461d-a2bb-5251bcfd9cf2',volume_size=None,volume_type=None)] {{(pid=116467) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 22:40:41.880905 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-eecb443e-daea-480a-8ff0-c09a8530acad tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.728230 Jan 24 22:40:41.881594 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 588/1158] 10.222.0.84 () {60 vars in 1146 bytes} [Mon Jan 24 22:40:41 2022] POST /compute/v2.1/servers => generated 404 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 24 22:40:41.894272 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-b786972e-720a-409f-90cc-2afa06ce2015 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:40:41.894961 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-b786972e-720a-409f-90cc-2afa06ce2015 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:40:41.952177 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-b786972e-720a-409f-90cc-2afa06ce2015 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:40:41.959833 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-b786972e-720a-409f-90cc-2afa06ce2015 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1095 microversion: 2.1 time: 0.071280 Jan 24 22:40:41.960496 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 571/1159] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:40:41 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:40:42.978184 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-62501291-c17c-49c0-8880-f10f26ec8504 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:40:42.979586 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-62501291-c17c-49c0-8880-f10f26ec8504 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:40:42.986588 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-62501291-c17c-49c0-8880-f10f26ec8504 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:42.987115 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-62501291-c17c-49c0-8880-f10f26ec8504 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:42.987990 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-62501291-c17c-49c0-8880-f10f26ec8504 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:42.988493 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-62501291-c17c-49c0-8880-f10f26ec8504 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:43.048391 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-62501291-c17c-49c0-8880-f10f26ec8504 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:40:43.056092 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-62501291-c17c-49c0-8880-f10f26ec8504 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1211 microversion: 2.1 time: 0.082187 Jan 24 22:40:43.056656 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 589/1160] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:40:42 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:40:44.073776 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-577622ec-e164-4d9b-9032-977713bf8646 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:40:44.074567 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-577622ec-e164-4d9b-9032-977713bf8646 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:40:44.081587 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-577622ec-e164-4d9b-9032-977713bf8646 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:44.082031 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-577622ec-e164-4d9b-9032-977713bf8646 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:44.082813 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-577622ec-e164-4d9b-9032-977713bf8646 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:44.083242 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-577622ec-e164-4d9b-9032-977713bf8646 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:44.230885 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-577622ec-e164-4d9b-9032-977713bf8646 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:40:44.238929 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-577622ec-e164-4d9b-9032-977713bf8646 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1265 microversion: 2.1 time: 0.168891 Jan 24 22:40:44.239607 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 572/1161] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:40:44 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:40:44.332919 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [req-3eaeaf42-85f7-41c6-8c7d-812fcd13faac req-e4616adf-c1a9-4ced-ac3b-54454ee83015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aed7041-39a2-45fc-a306-d8fea9532aff", "tag": "78911991-dc0e-4fb6-8897-79ddf6237e72"}]} {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:40:44.334538 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:40:44.334538 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: warnings.warn(msg) Jan 24 22:40:44.346332 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-3eaeaf42-85f7-41c6-8c7d-812fcd13faac req-e4616adf-c1a9-4ced-ac3b-54454ee83015 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:44.347743 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [req-3eaeaf42-85f7-41c6-8c7d-812fcd13faac req-e4616adf-c1a9-4ced-ac3b-54454ee83015 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:44.363121 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.compute.server_external_events [req-3eaeaf42-85f7-41c6-8c7d-812fcd13faac req-e4616adf-c1a9-4ced-ac3b-54454ee83015 service nova] Creating event network-changed:78911991-dc0e-4fb6-8897-79ddf6237e72 for instance 4aed7041-39a2-45fc-a306-d8fea9532aff on hv-cinder-81322 Jan 24 22:40:44.368160 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [req-3eaeaf42-85f7-41c6-8c7d-812fcd13faac req-e4616adf-c1a9-4ced-ac3b-54454ee83015 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039585 Jan 24 22:40:44.368691 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 590/1162] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:40:45.256888 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2ff1b4e9-ad4d-4e5d-8350-05b9c7508c1e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:40:45.257480 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2ff1b4e9-ad4d-4e5d-8350-05b9c7508c1e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:40:45.263958 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2ff1b4e9-ad4d-4e5d-8350-05b9c7508c1e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:45.264392 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2ff1b4e9-ad4d-4e5d-8350-05b9c7508c1e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:45.265195 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2ff1b4e9-ad4d-4e5d-8350-05b9c7508c1e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:45.265620 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2ff1b4e9-ad4d-4e5d-8350-05b9c7508c1e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:45.399937 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-2ff1b4e9-ad4d-4e5d-8350-05b9c7508c1e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:40:45.407524 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2ff1b4e9-ad4d-4e5d-8350-05b9c7508c1e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1265 microversion: 2.1 time: 0.154330 Jan 24 22:40:45.408089 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 573/1163] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:40:45 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:40:46.429128 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-04a0b800-9ac4-459f-8503-cf7bf0a6fa27 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:40:46.429923 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-04a0b800-9ac4-459f-8503-cf7bf0a6fa27 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:40:46.439789 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-04a0b800-9ac4-459f-8503-cf7bf0a6fa27 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:46.440482 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-04a0b800-9ac4-459f-8503-cf7bf0a6fa27 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:46.441833 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-04a0b800-9ac4-459f-8503-cf7bf0a6fa27 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:46.442531 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-04a0b800-9ac4-459f-8503-cf7bf0a6fa27 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:46.598742 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-04a0b800-9ac4-459f-8503-cf7bf0a6fa27 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:40:46.607351 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-04a0b800-9ac4-459f-8503-cf7bf0a6fa27 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1265 microversion: 2.1 time: 0.184965 Jan 24 22:40:46.607897 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 591/1164] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:40:46 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:40:47.629046 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-9e7142ed-d3c1-4cf4-b885-a6750f03cfdb tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:40:47.630005 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-9e7142ed-d3c1-4cf4-b885-a6750f03cfdb tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:40:47.640288 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9e7142ed-d3c1-4cf4-b885-a6750f03cfdb tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:47.641078 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9e7142ed-d3c1-4cf4-b885-a6750f03cfdb tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:47.642367 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9e7142ed-d3c1-4cf4-b885-a6750f03cfdb tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:47.643085 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-9e7142ed-d3c1-4cf4-b885-a6750f03cfdb tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:47.791658 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-9e7142ed-d3c1-4cf4-b885-a6750f03cfdb tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:40:47.802986 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-9e7142ed-d3c1-4cf4-b885-a6750f03cfdb tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1265 microversion: 2.1 time: 0.179978 Jan 24 22:40:47.803828 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 574/1165] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:40:47 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:40:48.825460 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-d25bbe78-c672-487f-b6ba-e8f08b0ba1c8 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:40:48.826129 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-d25bbe78-c672-487f-b6ba-e8f08b0ba1c8 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:40:48.833939 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d25bbe78-c672-487f-b6ba-e8f08b0ba1c8 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:48.834445 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d25bbe78-c672-487f-b6ba-e8f08b0ba1c8 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:48.835301 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d25bbe78-c672-487f-b6ba-e8f08b0ba1c8 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:48.835789 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-d25bbe78-c672-487f-b6ba-e8f08b0ba1c8 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:48.985658 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-d25bbe78-c672-487f-b6ba-e8f08b0ba1c8 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:40:48.996591 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-d25bbe78-c672-487f-b6ba-e8f08b0ba1c8 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1265 microversion: 2.1 time: 0.177083 Jan 24 22:40:48.997534 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 592/1166] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:40:48 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:40:50.018069 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-50b002c7-4d53-41f6-82ba-2c0f82aca237 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:40:50.018960 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-50b002c7-4d53-41f6-82ba-2c0f82aca237 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:40:50.028753 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-50b002c7-4d53-41f6-82ba-2c0f82aca237 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:50.029247 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-50b002c7-4d53-41f6-82ba-2c0f82aca237 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:50.030051 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-50b002c7-4d53-41f6-82ba-2c0f82aca237 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:50.030462 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-50b002c7-4d53-41f6-82ba-2c0f82aca237 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:50.177397 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-50b002c7-4d53-41f6-82ba-2c0f82aca237 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:40:50.185290 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-50b002c7-4d53-41f6-82ba-2c0f82aca237 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1265 microversion: 2.1 time: 0.173864 Jan 24 22:40:50.185855 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 575/1167] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:40:50 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:40:51.206769 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-5973ebf4-b159-4173-8d62-ac82e135b45b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:40:51.207919 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-5973ebf4-b159-4173-8d62-ac82e135b45b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:40:51.217622 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5973ebf4-b159-4173-8d62-ac82e135b45b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:51.218072 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5973ebf4-b159-4173-8d62-ac82e135b45b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:51.218958 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5973ebf4-b159-4173-8d62-ac82e135b45b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:51.219419 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-5973ebf4-b159-4173-8d62-ac82e135b45b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:51.367153 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-5973ebf4-b159-4173-8d62-ac82e135b45b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:40:51.375706 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-5973ebf4-b159-4173-8d62-ac82e135b45b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1265 microversion: 2.1 time: 0.176185 Jan 24 22:40:51.376251 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 593/1168] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:40:51 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:40:52.392753 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-60eec336-a3be-4abe-9d7b-5d3124d45c7a tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:40:52.393397 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-60eec336-a3be-4abe-9d7b-5d3124d45c7a tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:40:52.400040 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-60eec336-a3be-4abe-9d7b-5d3124d45c7a tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:52.400499 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-60eec336-a3be-4abe-9d7b-5d3124d45c7a tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:52.401318 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-60eec336-a3be-4abe-9d7b-5d3124d45c7a tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:52.401759 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-60eec336-a3be-4abe-9d7b-5d3124d45c7a tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:52.543327 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-60eec336-a3be-4abe-9d7b-5d3124d45c7a tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:40:52.551841 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-60eec336-a3be-4abe-9d7b-5d3124d45c7a tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1265 microversion: 2.1 time: 0.162978 Jan 24 22:40:52.552406 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 576/1169] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:40:52 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:40:53.574485 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-2f22aac0-a0db-4686-960a-8888a3015b76 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:40:53.575102 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-2f22aac0-a0db-4686-960a-8888a3015b76 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:40:53.584285 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2f22aac0-a0db-4686-960a-8888a3015b76 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:53.584853 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2f22aac0-a0db-4686-960a-8888a3015b76 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:53.585989 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2f22aac0-a0db-4686-960a-8888a3015b76 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:53.586501 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-2f22aac0-a0db-4686-960a-8888a3015b76 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:53.725693 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-2f22aac0-a0db-4686-960a-8888a3015b76 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:40:53.733493 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-2f22aac0-a0db-4686-960a-8888a3015b76 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1265 microversion: 2.1 time: 0.163390 Jan 24 22:40:53.734066 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 594/1170] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:40:53 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:40:54.755345 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-50adfa35-ca4c-4e39-9b1f-ba126d7fe19b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:40:54.756354 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-50adfa35-ca4c-4e39-9b1f-ba126d7fe19b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:40:54.766541 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-50adfa35-ca4c-4e39-9b1f-ba126d7fe19b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:54.767033 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-50adfa35-ca4c-4e39-9b1f-ba126d7fe19b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:54.767749 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-50adfa35-ca4c-4e39-9b1f-ba126d7fe19b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:54.768177 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-50adfa35-ca4c-4e39-9b1f-ba126d7fe19b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:54.920285 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-50adfa35-ca4c-4e39-9b1f-ba126d7fe19b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:40:54.928303 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-50adfa35-ca4c-4e39-9b1f-ba126d7fe19b tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1265 microversion: 2.1 time: 0.179192 Jan 24 22:40:54.928875 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 577/1171] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:40:54 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:40:55.949688 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f79dcefb-cebc-4cd2-8ffa-a6c7a3e26eae tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:40:55.951354 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-f79dcefb-cebc-4cd2-8ffa-a6c7a3e26eae tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:40:55.966657 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f79dcefb-cebc-4cd2-8ffa-a6c7a3e26eae tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:55.967106 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f79dcefb-cebc-4cd2-8ffa-a6c7a3e26eae tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:55.967905 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f79dcefb-cebc-4cd2-8ffa-a6c7a3e26eae tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:55.968337 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f79dcefb-cebc-4cd2-8ffa-a6c7a3e26eae tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:56.098550 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-a00d473e-3088-4281-86c1-3541d6b62917 req-5fedba1a-9228-4f6a-b301-c2b2de6ddc61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aed7041-39a2-45fc-a306-d8fea9532aff", "name": "network-vif-plugged", "status": "completed", "tag": "78911991-dc0e-4fb6-8897-79ddf6237e72"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:40:56.101698 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:40:56.101698 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:40:56.103334 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-f79dcefb-cebc-4cd2-8ffa-a6c7a3e26eae tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:40:56.110071 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-a00d473e-3088-4281-86c1-3541d6b62917 req-5fedba1a-9228-4f6a-b301-c2b2de6ddc61 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:56.110507 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-a00d473e-3088-4281-86c1-3541d6b62917 req-5fedba1a-9228-4f6a-b301-c2b2de6ddc61 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:56.112772 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-f79dcefb-cebc-4cd2-8ffa-a6c7a3e26eae tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1265 microversion: 2.1 time: 0.169906 Jan 24 22:40:56.113464 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 595/1172] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:40:55 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:40:56.124311 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-a00d473e-3088-4281-86c1-3541d6b62917 req-5fedba1a-9228-4f6a-b301-c2b2de6ddc61 service nova] Creating event network-vif-plugged:78911991-dc0e-4fb6-8897-79ddf6237e72 for instance 4aed7041-39a2-45fc-a306-d8fea9532aff on hv-cinder-81322 Jan 24 22:40:56.129396 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-a00d473e-3088-4281-86c1-3541d6b62917 req-5fedba1a-9228-4f6a-b301-c2b2de6ddc61 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034959 Jan 24 22:40:56.130032 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 578/1173] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:40:57.131026 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-98f968e1-d248-4f16-9c7c-8a9f04abef48 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:40:57.131644 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-98f968e1-d248-4f16-9c7c-8a9f04abef48 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:40:57.142362 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-98f968e1-d248-4f16-9c7c-8a9f04abef48 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:57.142999 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-98f968e1-d248-4f16-9c7c-8a9f04abef48 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:57.144179 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-98f968e1-d248-4f16-9c7c-8a9f04abef48 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:57.144840 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-98f968e1-d248-4f16-9c7c-8a9f04abef48 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:57.292344 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-98f968e1-d248-4f16-9c7c-8a9f04abef48 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:40:57.304189 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-98f968e1-d248-4f16-9c7c-8a9f04abef48 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1265 microversion: 2.1 time: 0.176646 Jan 24 22:40:57.304931 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 596/1174] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:40:57 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:40:58.329358 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-d5d6d325-754e-48ea-b89b-ce38cf8f85f1 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:40:58.332267 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-d5d6d325-754e-48ea-b89b-ce38cf8f85f1 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:40:58.337221 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d5d6d325-754e-48ea-b89b-ce38cf8f85f1 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:58.337703 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d5d6d325-754e-48ea-b89b-ce38cf8f85f1 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:58.338492 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d5d6d325-754e-48ea-b89b-ce38cf8f85f1 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:58.338922 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-d5d6d325-754e-48ea-b89b-ce38cf8f85f1 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:58.489342 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-d5d6d325-754e-48ea-b89b-ce38cf8f85f1 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:40:58.497207 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-d5d6d325-754e-48ea-b89b-ce38cf8f85f1 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1452 microversion: 2.1 time: 0.174875 Jan 24 22:40:58.497774 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 579/1175] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:40:58 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:40:58.513822 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-a83c72f8-f078-4015-a9a0-73bc333b0323 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:40:58.515006 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-a83c72f8-f078-4015-a9a0-73bc333b0323 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:40:58.521572 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a83c72f8-f078-4015-a9a0-73bc333b0323 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:58.522016 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a83c72f8-f078-4015-a9a0-73bc333b0323 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:58.522779 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a83c72f8-f078-4015-a9a0-73bc333b0323 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:40:58.523205 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-a83c72f8-f078-4015-a9a0-73bc333b0323 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:40:58.670629 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-a83c72f8-f078-4015-a9a0-73bc333b0323 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:40:58.682866 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-a83c72f8-f078-4015-a9a0-73bc333b0323 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1452 microversion: 2.1 time: 0.172445 Jan 24 22:40:58.683757 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 597/1176] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:40:58 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:41:00.637014 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-00477ab2-ed8b-495d-ba3a-402ee63b5631 req-abd54e69-3674-4b12-bb2f-3aa51d829135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aed7041-39a2-45fc-a306-d8fea9532aff", "tag": "78911991-dc0e-4fb6-8897-79ddf6237e72"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:41:00.638274 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:41:00.638274 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:41:00.645614 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-00477ab2-ed8b-495d-ba3a-402ee63b5631 req-abd54e69-3674-4b12-bb2f-3aa51d829135 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:41:00.646493 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-00477ab2-ed8b-495d-ba3a-402ee63b5631 req-abd54e69-3674-4b12-bb2f-3aa51d829135 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:41:00.658286 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-00477ab2-ed8b-495d-ba3a-402ee63b5631 req-abd54e69-3674-4b12-bb2f-3aa51d829135 service nova] Creating event network-changed:78911991-dc0e-4fb6-8897-79ddf6237e72 for instance 4aed7041-39a2-45fc-a306-d8fea9532aff on hv-cinder-81322 Jan 24 22:41:00.664282 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-00477ab2-ed8b-495d-ba3a-402ee63b5631 req-abd54e69-3674-4b12-bb2f-3aa51d829135 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034545 Jan 24 22:41:00.665112 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 580/1177] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:41:23.188754 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 22:41:23.189775 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: Mon Jan 24 22:41:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 22:42:30.846486 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-c77c568e-a181-4d15-998e-5732c6f81288 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:42:30.847117 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c77c568e-a181-4d15-998e-5732c6f81288 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:42:30.853603 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-27dbbf69-9852-460d-8bf7-f958df440c36 req-db14b28b-382a-441f-86a6-03c67b391cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aed7041-39a2-45fc-a306-d8fea9532aff", "tag": "78911991-dc0e-4fb6-8897-79ddf6237e72"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:42:30.855082 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:42:30.855082 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:42:30.863214 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c77c568e-a181-4d15-998e-5732c6f81288 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:30.863706 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c77c568e-a181-4d15-998e-5732c6f81288 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:30.864470 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c77c568e-a181-4d15-998e-5732c6f81288 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:30.864842 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-27dbbf69-9852-460d-8bf7-f958df440c36 req-db14b28b-382a-441f-86a6-03c67b391cf6 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:30.864966 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-c77c568e-a181-4d15-998e-5732c6f81288 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:30.865318 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-27dbbf69-9852-460d-8bf7-f958df440c36 req-db14b28b-382a-441f-86a6-03c67b391cf6 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:30.876799 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-27dbbf69-9852-460d-8bf7-f958df440c36 req-db14b28b-382a-441f-86a6-03c67b391cf6 service nova] Creating event network-changed:78911991-dc0e-4fb6-8897-79ddf6237e72 for instance 4aed7041-39a2-45fc-a306-d8fea9532aff on hv-cinder-81322 Jan 24 22:42:30.882172 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-27dbbf69-9852-460d-8bf7-f958df440c36 req-db14b28b-382a-441f-86a6-03c67b391cf6 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033414 Jan 24 22:42:30.883007 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 581/1178] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:42:30.890769 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-c77c568e-a181-4d15-998e-5732c6f81288 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Going to try to terminate instance {{(pid=116467) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:42:30.973930 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-c77c568e-a181-4d15-998e-5732c6f81288 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "DELETE /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 204 len: 0 microversion: 2.1 time: 0.131869 Jan 24 22:42:30.978440 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 598/1179] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:42:30 2022] DELETE /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:42:30.983776 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-2e7fcf7b-d3a8-44d4-b6c8-9dd2c5a357f0 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:42:30.984713 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-2e7fcf7b-d3a8-44d4-b6c8-9dd2c5a357f0 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:42:30.990995 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2e7fcf7b-d3a8-44d4-b6c8-9dd2c5a357f0 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:30.991442 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2e7fcf7b-d3a8-44d4-b6c8-9dd2c5a357f0 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:30.992218 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2e7fcf7b-d3a8-44d4-b6c8-9dd2c5a357f0 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:30.992646 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-2e7fcf7b-d3a8-44d4-b6c8-9dd2c5a357f0 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:31.133214 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-2e7fcf7b-d3a8-44d4-b6c8-9dd2c5a357f0 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:42:31.140674 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-2e7fcf7b-d3a8-44d4-b6c8-9dd2c5a357f0 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1576 microversion: 2.1 time: 0.161339 Jan 24 22:42:31.141643 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 582/1180] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:42:30 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:42:32.159017 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-309ba0e3-33f8-462a-8a91-ca6dd8700c58 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:42:32.159702 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-309ba0e3-33f8-462a-8a91-ca6dd8700c58 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:42:32.166636 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-309ba0e3-33f8-462a-8a91-ca6dd8700c58 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:32.167083 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-309ba0e3-33f8-462a-8a91-ca6dd8700c58 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:32.167838 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-309ba0e3-33f8-462a-8a91-ca6dd8700c58 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:32.168263 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-309ba0e3-33f8-462a-8a91-ca6dd8700c58 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:32.315828 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-309ba0e3-33f8-462a-8a91-ca6dd8700c58 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:42:32.323971 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-309ba0e3-33f8-462a-8a91-ca6dd8700c58 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1458 microversion: 2.1 time: 0.169052 Jan 24 22:42:32.324549 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 599/1181] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:42:32 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1458 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:42:33.228420 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-edeec5b3-87b6-4584-9c31-5aa93012362c req-c63f9823-72a2-415d-bea7-daec0a699d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aed7041-39a2-45fc-a306-d8fea9532aff", "name": "network-vif-deleted", "tag": "78911991-dc0e-4fb6-8897-79ddf6237e72"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:42:33.229956 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:42:33.229956 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:42:33.239119 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-edeec5b3-87b6-4584-9c31-5aa93012362c req-c63f9823-72a2-415d-bea7-daec0a699d33 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:33.239735 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-edeec5b3-87b6-4584-9c31-5aa93012362c req-c63f9823-72a2-415d-bea7-daec0a699d33 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:33.253084 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-edeec5b3-87b6-4584-9c31-5aa93012362c req-c63f9823-72a2-415d-bea7-daec0a699d33 service nova] Creating event network-vif-deleted:78911991-dc0e-4fb6-8897-79ddf6237e72 for instance 4aed7041-39a2-45fc-a306-d8fea9532aff on hv-cinder-81322 Jan 24 22:42:33.258036 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-edeec5b3-87b6-4584-9c31-5aa93012362c req-c63f9823-72a2-415d-bea7-daec0a699d33 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033210 Jan 24 22:42:33.258605 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 583/1182] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:42:33.343806 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-9e2e0acc-7c0f-4c5f-94f5-d78dded1894e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:42:33.344592 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-9e2e0acc-7c0f-4c5f-94f5-d78dded1894e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:42:33.351307 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9e2e0acc-7c0f-4c5f-94f5-d78dded1894e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:33.351886 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9e2e0acc-7c0f-4c5f-94f5-d78dded1894e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:33.352659 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9e2e0acc-7c0f-4c5f-94f5-d78dded1894e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:33.353112 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-9e2e0acc-7c0f-4c5f-94f5-d78dded1894e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:33.413553 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-9e2e0acc-7c0f-4c5f-94f5-d78dded1894e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:42:33.421224 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-9e2e0acc-7c0f-4c5f-94f5-d78dded1894e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 200 len: 1226 microversion: 2.1 time: 0.081121 Jan 24 22:42:33.421790 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 600/1183] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:42:33 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:42:34.441023 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-19c6b28c-e5a1-4bc2-a9ed-d88631dcc631 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:42:34.441856 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-19c6b28c-e5a1-4bc2-a9ed-d88631dcc631 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 4aed7041-39a2-45fc-a306-d8fea9532aff] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:42:34.450005 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19c6b28c-e5a1-4bc2-a9ed-d88631dcc631 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:34.450593 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19c6b28c-e5a1-4bc2-a9ed-d88631dcc631 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:34.451534 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19c6b28c-e5a1-4bc2-a9ed-d88631dcc631 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:34.452033 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-19c6b28c-e5a1-4bc2-a9ed-d88631dcc631 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:34.465828 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-19c6b28c-e5a1-4bc2-a9ed-d88631dcc631 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] HTTP exception thrown: Instance 4aed7041-39a2-45fc-a306-d8fea9532aff could not be found. Jan 24 22:42:34.466450 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-19c6b28c-e5a1-4bc2-a9ed-d88631dcc631 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Returning 404 to user: Instance 4aed7041-39a2-45fc-a306-d8fea9532aff could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:42:34.467272 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-19c6b28c-e5a1-4bc2-a9ed-d88631dcc631 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff" status: 404 len: 111 microversion: 2.1 time: 0.031556 Jan 24 22:42:34.467820 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 584/1184] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:42:34 2022] GET /compute/v2.1/servers/4aed7041-39a2-45fc-a306-d8fea9532aff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:42:37.599978 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-237045f3-a40c-465a-af52-a1184036e52e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:42:37.600504 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-237045f3-a40c-465a-af52-a1184036e52e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:42:37.607670 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-237045f3-a40c-465a-af52-a1184036e52e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:37.608206 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-237045f3-a40c-465a-af52-a1184036e52e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:37.609098 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-237045f3-a40c-465a-af52-a1184036e52e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:37.609603 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-237045f3-a40c-465a-af52-a1184036e52e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:37.612358 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-a23ccf1e-2919-466c-aa59-126414f38e15 req-9f0b9bb4-cc94-4aa0-b16e-92332821b547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b47787b-bc59-4796-a933-33b728d46c06", "tag": "2f024c9b-bf4d-42cc-9e19-4a9be6c5b36f"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:42:37.616265 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:42:37.616265 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:42:37.626531 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-a23ccf1e-2919-466c-aa59-126414f38e15 req-9f0b9bb4-cc94-4aa0-b16e-92332821b547 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:37.626944 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-a23ccf1e-2919-466c-aa59-126414f38e15 req-9f0b9bb4-cc94-4aa0-b16e-92332821b547 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:37.636763 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-237045f3-a40c-465a-af52-a1184036e52e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Going to try to terminate instance {{(pid=116467) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 22:42:37.638336 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-a23ccf1e-2919-466c-aa59-126414f38e15 req-9f0b9bb4-cc94-4aa0-b16e-92332821b547 service nova] Creating event network-changed:2f024c9b-bf4d-42cc-9e19-4a9be6c5b36f for instance 3b47787b-bc59-4796-a933-33b728d46c06 on hv-cinder-81322 Jan 24 22:42:37.643759 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-a23ccf1e-2919-466c-aa59-126414f38e15 req-9f0b9bb4-cc94-4aa0-b16e-92332821b547 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038203 Jan 24 22:42:37.644910 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 585/1185] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:42:37.723428 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-237045f3-a40c-465a-af52-a1184036e52e tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "DELETE /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 204 len: 0 microversion: 2.1 time: 0.126767 Jan 24 22:42:37.724233 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 601/1186] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:42:37 2022] DELETE /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 22:42:37.733028 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-af71df72-0c9e-4675-ba63-963505d129be tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:42:37.734025 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-af71df72-0c9e-4675-ba63-963505d129be tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:42:37.740365 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-af71df72-0c9e-4675-ba63-963505d129be tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:37.740810 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-af71df72-0c9e-4675-ba63-963505d129be tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:37.741618 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-af71df72-0c9e-4675-ba63-963505d129be tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:37.742046 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-af71df72-0c9e-4675-ba63-963505d129be tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:37.879422 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.policy [None req-af71df72-0c9e-4675-ba63-963505d129be tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116466) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:42:37.887736 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-af71df72-0c9e-4675-ba63-963505d129be tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1575 microversion: 2.1 time: 0.158746 Jan 24 22:42:37.888612 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 586/1187] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:42:37 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 22:42:38.910746 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-f93eed0c-8856-42d0-b069-aa9e60c50934 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:42:38.911907 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-f93eed0c-8856-42d0-b069-aa9e60c50934 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:42:38.922363 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f93eed0c-8856-42d0-b069-aa9e60c50934 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:38.923104 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f93eed0c-8856-42d0-b069-aa9e60c50934 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:38.924372 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f93eed0c-8856-42d0-b069-aa9e60c50934 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:38.925180 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-f93eed0c-8856-42d0-b069-aa9e60c50934 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:39.065196 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-f93eed0c-8856-42d0-b069-aa9e60c50934 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:42:39.077273 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-f93eed0c-8856-42d0-b069-aa9e60c50934 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1457 microversion: 2.1 time: 0.173680 Jan 24 22:42:39.078028 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 602/1188] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:42:38 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1457 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:42:39.929693 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [req-4f7579c5-8e77-43c6-bb5f-bdd2f31cc9ed req-b598f123-5cd6-4302-b1d1-9b80ff7c2450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b47787b-bc59-4796-a933-33b728d46c06", "name": "network-vif-deleted", "tag": "2f024c9b-bf4d-42cc-9e19-4a9be6c5b36f"}]} {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 22:42:39.931181 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 22:42:39.931181 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: warnings.warn(msg) Jan 24 22:42:39.939072 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-4f7579c5-8e77-43c6-bb5f-bdd2f31cc9ed req-b598f123-5cd6-4302-b1d1-9b80ff7c2450 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:39.939458 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [req-4f7579c5-8e77-43c6-bb5f-bdd2f31cc9ed req-b598f123-5cd6-4302-b1d1-9b80ff7c2450 service nova] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:39.950894 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.compute.server_external_events [req-4f7579c5-8e77-43c6-bb5f-bdd2f31cc9ed req-b598f123-5cd6-4302-b1d1-9b80ff7c2450 service nova] Creating event network-vif-deleted:2f024c9b-bf4d-42cc-9e19-4a9be6c5b36f for instance 3b47787b-bc59-4796-a933-33b728d46c06 on hv-cinder-81322 Jan 24 22:42:39.955716 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [req-4f7579c5-8e77-43c6-bb5f-bdd2f31cc9ed req-b598f123-5cd6-4302-b1d1-9b80ff7c2450 service nova] 10.222.0.84 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029677 Jan 24 22:42:39.956392 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 587/1189] 10.222.0.84 () {64 vars in 1317 bytes} [Mon Jan 24 22:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 22:42:40.094724 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-923eaebc-5fcc-4d7f-aa7e-51ba0d1d9674 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:42:40.095313 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-923eaebc-5fcc-4d7f-aa7e-51ba0d1d9674 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:42:40.102143 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-923eaebc-5fcc-4d7f-aa7e-51ba0d1d9674 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:40.102592 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-923eaebc-5fcc-4d7f-aa7e-51ba0d1d9674 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:40.103364 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-923eaebc-5fcc-4d7f-aa7e-51ba0d1d9674 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:40.103792 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-923eaebc-5fcc-4d7f-aa7e-51ba0d1d9674 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:40.172287 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.policy [None req-923eaebc-5fcc-4d7f-aa7e-51ba0d1d9674 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9bf7472d3843efbcade92387a0ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e579d6f341241508dfd3800965f27c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116467) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 22:42:40.180165 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-923eaebc-5fcc-4d7f-aa7e-51ba0d1d9674 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 200 len: 1226 microversion: 2.1 time: 0.089185 Jan 24 22:42:40.180734 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 603/1190] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:42:40 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 22:42:41.202310 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1df1b8ae-da96-4618-a7cc-1d8c24494870 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:42:41.203449 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-1df1b8ae-da96-4618-a7cc-1d8c24494870 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 3b47787b-bc59-4796-a933-33b728d46c06] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:42:41.211978 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1df1b8ae-da96-4618-a7cc-1d8c24494870 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:41.212414 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1df1b8ae-da96-4618-a7cc-1d8c24494870 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:41.213219 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1df1b8ae-da96-4618-a7cc-1d8c24494870 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:41.213646 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-1df1b8ae-da96-4618-a7cc-1d8c24494870 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:41.227074 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-1df1b8ae-da96-4618-a7cc-1d8c24494870 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] HTTP exception thrown: Instance 3b47787b-bc59-4796-a933-33b728d46c06 could not be found. Jan 24 22:42:41.227645 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-1df1b8ae-da96-4618-a7cc-1d8c24494870 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Returning 404 to user: Instance 3b47787b-bc59-4796-a933-33b728d46c06 could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:42:41.228466 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-1df1b8ae-da96-4618-a7cc-1d8c24494870 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06" status: 404 len: 111 microversion: 2.1 time: 0.033683 Jan 24 22:42:41.229002 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 588/1191] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:42:41 2022] GET /compute/v2.1/servers/3b47787b-bc59-4796-a933-33b728d46c06 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:42:41.720328 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0fb8174b-bbab-4d9e-b869-39a4cf90fcc3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:42:41.720860 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.compute.api [None req-0fb8174b-bbab-4d9e-b869-39a4cf90fcc3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116467) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:42:41.727663 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0fb8174b-bbab-4d9e-b869-39a4cf90fcc3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:41.728105 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0fb8174b-bbab-4d9e-b869-39a4cf90fcc3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:41.728871 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0fb8174b-bbab-4d9e-b869-39a4cf90fcc3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:41.729335 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG oslo_concurrency.lockutils [None req-0fb8174b-bbab-4d9e-b869-39a4cf90fcc3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:41.744837 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.wsgi [None req-0fb8174b-bbab-4d9e-b869-39a4cf90fcc3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] HTTP exception thrown: Instance 294678b9-e38b-4c90-8b10-52275ca06521 could not be found. Jan 24 22:42:41.745442 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-0fb8174b-bbab-4d9e-b869-39a4cf90fcc3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Returning 404 to user: Instance 294678b9-e38b-4c90-8b10-52275ca06521 could not be found. {{(pid=116467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:42:41.746579 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-0fb8174b-bbab-4d9e-b869-39a4cf90fcc3 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "DELETE /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 404 len: 111 microversion: 2.1 time: 0.029692 Jan 24 22:42:41.747117 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 604/1192] 10.222.0.84 () {58 vars in 1238 bytes} [Mon Jan 24 22:42:41 2022] DELETE /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:42:41.758134 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-24c798d4-eeac-4e46-9c45-e3c53af111e6 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '>' {{(pid=116466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:42:41.758980 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.compute.api [None req-24c798d4-eeac-4e46-9c45-e3c53af111e6 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] [instance: 294678b9-e38b-4c90-8b10-52275ca06521] Fetching instance by UUID {{(pid=116466) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 22:42:41.767687 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-24c798d4-eeac-4e46-9c45-e3c53af111e6 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:41.768272 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-24c798d4-eeac-4e46-9c45-e3c53af111e6 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:41.769094 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-24c798d4-eeac-4e46-9c45-e3c53af111e6 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 22:42:41.769661 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG oslo_concurrency.lockutils [None req-24c798d4-eeac-4e46-9c45-e3c53af111e6 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Lock "eb394668-0391-4ba1-895f-69ebb5c46286" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 22:42:41.783551 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.wsgi [None req-24c798d4-eeac-4e46-9c45-e3c53af111e6 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] HTTP exception thrown: Instance 294678b9-e38b-4c90-8b10-52275ca06521 could not be found. Jan 24 22:42:41.784127 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: DEBUG nova.api.openstack.wsgi [None req-24c798d4-eeac-4e46-9c45-e3c53af111e6 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Returning 404 to user: Instance 294678b9-e38b-4c90-8b10-52275ca06521 could not be found. {{(pid=116466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 22:42:41.784963 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO nova.api.openstack.requestlog [None req-24c798d4-eeac-4e46-9c45-e3c53af111e6 tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521" status: 404 len: 111 microversion: 2.1 time: 0.033176 Jan 24 22:42:41.785532 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: [pid: 116466|app: 0|req: 589/1193] 10.222.0.84 () {58 vars in 1235 bytes} [Mon Jan 24 22:42:41 2022] GET /compute/v2.1/servers/294678b9-e38b-4c90-8b10-52275ca06521 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 22:42:43.098580 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: DEBUG nova.api.openstack.wsgi [None req-6b848107-cc44-4250-b5ca-cd37f9476ace tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] Calling method '.version_select at 0x7f7e61e6f280>' {{(pid=116467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 22:42:43.122825 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO nova.api.openstack.requestlog [None req-6b848107-cc44-4250-b5ca-cd37f9476ace tempest-TestVolumeBootPattern-306328963 tempest-TestVolumeBootPattern-306328963-project] 10.222.0.84 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1514835326" status: 202 len: 0 microversion: 2.1 time: 0.027891 Jan 24 22:42:43.123396 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: [pid: 116467|app: 0|req: 605/1194] 10.222.0.84 () {58 vars in 1262 bytes} [Mon Jan 24 22:42:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1514835326 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 22:42:49.508005 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 22:42:49.508579 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: Mon Jan 24 22:42:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 22:43:04.305919 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 22:43:04.307001 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: Mon Jan 24 22:43:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 22:46:09.519759 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 22:46:09.520699 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: Mon Jan 24 22:46:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 22:46:13.080013 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 22:46:13.081077 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: Mon Jan 24 22:46:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 22:46:24.318387 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 22:46:24.319349 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: Mon Jan 24 22:46:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 22:48:03.210927 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 22:48:03.212113 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: Mon Jan 24 22:48:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 22:48:14.033344 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 22:48:14.033344 dv-cinder-813223-4-iscsi devstack@n-api.service[116467]: Mon Jan 24 22:48:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 22:48:16.574435 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 22:48:16.574435 dv-cinder-813223-4-iscsi devstack@n-api.service[116466]: Mon Jan 24 22:48:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!